Problem's answering calls on Samsung Galaxy A5 2016

I have samsung galaxy a5 2016
I am having a problem when someone call's me when i have my phone on my poket many times i reject the call or answer it without knowing it. Is the a way to fix it because many friends are thinking that i am doing it on purpose. And my girlfriend isn't talking to me because i have rejected her call 2 or 3 times. Can someone help me

from Android Authority Forums http://ift.tt/2nvj9gF
via IFTTT