I have done exhaustive research regarding this in the past but I still have persistent problems with latency when using QuickTime or MPEG-4 streaming in my projects so I am doing the research again (and posting it here so I can find it later).
Here are the links for further examination (from Apple’s Mailing Lists):
Latency on Streaming Server – Some information – How to change a setting on the QTSS that controls one aspect of latency created by the server.
Re: latency problem – Explains the reasoning for the latency from Apple’s point of view.
Re: Instant-On & double frame rate – Gives a rundown on editing the server config to reduce latency.
Re: Video conferencing – More of the same
Getting real-time streaming to be more real-time – interesting note regarding specifing time stamp increments in video/audio samples to reduce latency. A major hack.
Re: I found there are more than 7 seconds time delay between the real live – More about what the latency is all about.
Re: Getting real-time streaming to be more real-time – Change the SDP file to set the default buffer on the player lower.
Re: Streaming latency between two separate computers – Use multicast
Re: Request for User-Configurable Latency Parameters – One of the original emails quoted above for changing latency parameters.
Re: buffering time – Changing buffering time in home made QT playback app (using QT API, should therefore work with QT4J).
Re: buffering time – More of the same.
Last: Use these libraries to build own streaming server and client: LIVE.COM Streaming Media: RTP/RTCP and RTSP Open Source Libraries
Ok.. now to try out all of the possibilities..
I experience QuickTime latency all the time. It doesn’t even matter if it’s streaming. The audio lags the video, even for a .mov on my hard drive. I can’t figure it out. I keep hitting the pause button, then play–which only helps for a few seconds.
Correction to above comment: The video lags behind the audio. (I had it the other way around)