Your steps in Decrypt are wrong. First, decrypt the incoming byte data w/o converting it to a string. Take the decrypted byte array and turn it into a string. Turn string into byte array with BytesFromHex. Even though that would do it, don't.
Why are you converting the byte array to a string in encrypt just to convert it to a byte array again in order to encrypt it? Just encrypt the byte array (CLR) which will result in the encrypted byte array Enc. In decrypt, just decrypt EncryptedData directly, resulting in the decrypted audio data in Dec.