Just guessing from a similar case using SOAP, depending on the message structure and server implementarion, there's sometimes in the header a "ReplyTo" and/or "From" field. So, the answer doesn't go to the packet's sender but to the address pointed by this field.