Ringtone keeps ringing a few seconds after answering the call

It is not always the case and it seems to happen when answering a call from the lock-screen, the ringtone keeps ringing during around 5 seconds after answering the call so the person calling can hear my phone ring.