Client-side Prediction

I was reading about client-side prediction in the context of video game physics today and thought of an idea: client-side prediction on streamed video (e.g. on Skype or similar video chats). Each pixel could be assigned a velocity and “color velocity” (, , ). A velocity grid method like the one described in Practical Fluid Dynamics 1 and 2 comes to mind.