Is telling someone I accidentally did a sin sinful on me?

Some non-muslims kept asking me if I did a certain sin, and were accusing me of doing so when I dodged the question, I said I did it accidentally, and then later explained that I did something permissible (but that permissible thing kinda looks like/could lead to the haram thing or could be mistaken for it), is this sinful, and am I sinful for such? (I didn't realize until after I said such that it could be sinful).