Hello ,
From your description i understood that your mails send from your exchange servers to external domain like gmail, yahoo are delivered with delay .
1.Analyze the received message headers either through MX Toolbox or through remote connectivity analyzer to find out the reason for the delay .
2.Then do a message track in your exchange server as well on gateway product to find out the reason.
Thanks & Regards S.Nithyanandham