You can basically send anything you want using libdatachannel.
Ha ha yes but audio and video must still be encoded properly
Thanks, I really appreciate the help with that! I do have a followup question - using the same sort of idea, the data I'm currently sending over the datachannel is somewhat analogous to video in a normal video call situation. I'm taking care of the encoding and decoding myself to essentially produce the "frame" that is being sent through the datachannel. Would it be better/possible to leverage the videostream in this sense to send this arbitrary piece of data which represents a frame?
I guess possible benefits I'm looking for are the synchronisation with the audio and achieving even lower latency with the features of a full media stream.
RTC_DEFAULT_MAXIMUM_FRAGMENT_SIZE, which is 1140 bytes), and contrary to data channels there is no retransmission or loss correction, you have to handle that yourself.