A Novel Motion Recovery Using Temporal and Spatial Correlation over H.264 Video Sequences

 2023.11.8.

The respected Comrade Kim Jong Un said:

"Great efforts should be made in the field of cutting-edge science and technology to develop technologies with a world-class competitive edge."

It is well-known that data communication through wireless networks such as mobile communication experiences high packet error rate due to various fading in wireless channel. Especially, when H.264 or HEVC video sequences are transmitted through error-prone environment such as wireless channel, vehicle network or internet, if there occurs one-bit error in transmission, then displeasing images appear in display due to the propagation of the one-bit error over all the consecutive video frames.

The previous works used correction using neighboring pixels of proceeding or current frame in case of slow motion video frames, but it doesn't show good correction in case of fast motion video frames.

The proposed algorithm uses temporal and spatial motion vectors of a lost block and neighboring blocks. A neighboring block with minimum SAD-MV(Sum of Absolute Difference-Motion Vector) between its trajectory and trajectory of lost block is chosen as the most reliable candidate. In order to avoid the mosaic artifacts in the process of recombination of optimal blocks, final motion vector of the block is recalculated using H.264 partition information and then H,.264 1/4 interpolation is followed. Then this method, compared with previous methods on PSNR, shows higher speed and better quality The proposed algorithm may be used as a powerful correction tool in real-time video transmission of mobile phone, tactile screen or cameras of wireless sensor networks using H.264/AVC decoders. In particular, due to the little memory usage, high performance is expected in ROI(Region Of Interest) tracking applications.

Images concealed
Fig. Images concealed by several methods. (‘Foreman': BER 5%, frame 82th, QP 28). (a): zero MV(28.78 dB), (b): 16ED-BMA (30.57 dB), (c): Polynomial (30.98 dB), (d): Proposed method (31.75 dB)

This research was published on "Multimedia tools and applications" under the title of "A novel motion recovery using temporal and spatial concealment for a fast temporal error concealment over H.264 video sequences"(https://doi.org/10.1007/s11042-019-08176-x).