A package was taken away

I was watching my grammar video about 4:00 o'clock pm. A delivery man came and asked me."who wants to delive a package?"  I was all by myself in our department at that time. I told him I haven't any package and informed him to ask the other two departments. He came back soon without any package and found one in my colleague's table which is  nearby my table.He took away the package.

My colleague came back  after 15 minutes later, and found his package disappeared. He shouted ,"who took away my package?" I said," A delivery man has  come 15 minutes ago and took it away." Then I found he became angry and blamed on me,"why did you give him my package?" I looked at him with a big surprise. First, I haven't called a deliver. Second, He hasn't asked me to look after his package. I asked," Is it my duty?" He hasn't answered. Then he called the deliver back in bad attitude. Because his package hasn't prepared well.

I think it is unimaginable of his doing. First, he called a deliver come but hasn't informed them the time to take the package  this afternoon. Second, he hasn't told me about his package before leaving the office.  But he was angry with others with his fault.