Laboratory for Image and Video Engineering - The ...

In this paper, foveation, a property of the HVS, is exploited in video transcoding. The proposed foveation embedded DCT domain video transcoding can reduce the bit rate without compromising visual quality or achieve better subjective quality for a given bit rate by shaping the compression distortion according to the foveated contrast ...

Dynamic Gaze Span W indow based Foveation for Perceptual ...

loop delay associated with streaming in the network. We have designed a live eye gaze interaction based dynamic foveation windowing scheme to address the challenge. 1 Introduction The human vision offers a tremendous scope of perceptual data reduction. Only about 2 degree in our about 140 degrees vision span has sharp vision. There

Off-line Foveated Video: Effects on Compression and …

•Simuli: Six videos compressed at high bit rates, before and after off-line foveation (hence 12 videos in total). • Videos shown in random order together with 12 pictures. Repeated two times. • 15 naive subjects free-viewing (measure pupil size) • Eye-tracking: SMI iViewX Hi-Speed, 240 Hz

60 MS TO GET IT RIGHT - Nvidia

60 MS TO GET IT RIGHT GAZE-CONTINGENT RENDERING & HUMAN PERCEPTION. 2 GOAL: IMMERSIVE VR ... •Some bit depth reduction is not noticeable in the ... •Amount of foveation varied based on responses 1 up/ 1 down adaptive staircase Foveation level = shading rate per 2^N pixels (higher is better) ...

Hack Audio: Bit Reduction - YouTube

Jul 02, 2017· Bit reduction ("bit crushing") is a type of distortion effect which simulates the process of converting an analog signal to a digital signal with different levels of bit depth. A processed, output ...

Foveation embedded DCT domain video transcoding ...

The proposed foveation embedded DCT domain video transcoding can reduce the bit rate without compromising visual quality or achieve better subjective quality for a given bit rate by shaping the compression distortion according to the foveated contrast sensitivity function of the HVS.

(PDF) Very low bit rate foveated video coding for H.263

Then, we demonstrate that foveation, as described by this model, can be incorporated into standard motion compensation and discrete cosine transform (DCT)-based video coding techniques for low bit ...

438 IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL …

improve video quality in low bit rate transmissions [12]–[15]. However, it is unclear whether or not there is a way to quantify ... pling rate reduction based on foveation with no perceptual loss (we also compute this perceptual efficiency for a number of re-cent displaysto show the …

Real-Time Foveation Techniques for Low Bit Rate Video Coding

Real-Time Foveation Techniques for Low Bit Rate Video Coding Hamid R. Sheikh, Brian L. Evans and Alan C. Bovik Abstract Lossy video compression methods often rely on modeling the abilities and limitations of the intended receiver, the Human Visual System (HVS), to achieve the highest possible

Foveation Embedded DCT Domain Video | Request PDF

The proposed foveation embedded DCT domain video transcoding can reduce the bit rate without compromising visual quality or achieve better subjective quality for a given bit rate by shaping the ...

Foveated Image and Video Coding | Semantic Scholar

The human visual system (HVS) is highly space-variant in sampling, coding, processing, and understanding of visual information. The visual sensitivity is highest at the point of fixation and decreases dramatically with distance from the point of fixation. By taking advantage of this phenomenon, foveated image and video coding systems achieve increased compression efficiency by removing ...

Foveation-based reduced resolution driving scheme for ...

In this paper, we propose an embedded foveation image coding (EFIC) algorithm, which orders the encoded bitstream to optimize foveated visual quality at arbitrary bit-rates. A foveation-based ...

Perceptually-lossless image coding based on foveated-JND ...

Based on the discussion in subSection 2.1, we have designed an image pattern to incorporate the contrast masking effect with the retina eccentricity.During the experiments, a test image generated using the predefined contrast eh, background bg and eccentricity e, was shown on the screen.As shown in Fig. 1, the test image contained a circular area whose radius was calculated as the product of ...

Introducing a New Foveation Pipeline for Virtual/Mixed Reality

Dec 05, 2017· Posted by Behnam Bastani, Software Engineer Manager and Eric Turner, Software Engineer, Daydream Virtual Reality (VR) and Mixed Reality (MR) offer a novel way to immerse people into new and compelling experiences, from gaming to professional training. However, current VR/MR technologies present a fundamental challenge: to present images at the extremely high resolution …

Adaptive foveation of MPEG video | DeepDyve

Adaptive foveation of MPEG video Adaptive foveation of MPEG video Reeves, T. H.; Robinson, J. A. 1997-02-01 00:00:00 Adaptive Foveation of MPEG Video Department T H Reeves of Systems Design University Ontario, of Waterloo Chada, N2L 3G1 Engineering J A Robinson Faculty of Engineering and Applied IScience Memorial University of Newfoundland Newfoundland, Canada, AIB 3X5 …

Day 2 Immerse Pillar TimLeland - Mobile Technology

8-Bit 2.07 Megapixels 16.78 Million Colors 8-Bit 8.29 Megapixels ... Tile-based Foveation with Eye-Tracking Multiview Rendering Fine Grain Preemption ... highlights Room-Scale 6DOF with SLAM Adreno Foveation 2K x 2K @ 120 fps XR 30% Faster Graphics and Video 30% Power Reduction Improved 6DOF Hand Tracking and Controller support Iris ...

A game attention model for efficient bit rate allocation ...

Apr 27, 2014· To meet the stringent network bandwidth requirements of cloud gaming and support more players, efficient bit rate reduction techniques are needed. In this paper, we introduce the concept of game attention model (GAM), which is basically a game context-based visual attention model, as a means for reducing the bit rate of the streaming video more ...

High quality, low delay foveated visual communications ...

Based on a maximum source throughput criterion, the source and channel video transmission rates and the target video coding bit rate are adaptively decided according to the channel dynamics. In the simulations, we use the channel throughput, the spatial/temporal resolution, and the transmission delay as criteria to compare the performance of ...

CHAPTER 1

In this section describes the estimation for possible bit rate reduction for a simple bit-rate reduction scheme. This method assumes that the area of RW is encoded with highest possible quality and the rest of the video frame is encoded with a fraction of the RW quality. (4.5.1) is overall possible compression. F(i) represents video frame.

Video News - CNN

Watch breaking news videos, viral videos and original video clips on CNN.com.

Predictive Perceptual Compression for Real Time Video ...

speed information is used to construct a saccade window. Based on this approach, we have implemented a real-time foveation-aware perceptual video streaming transcoder with a fixed target bit-rate. Our transcoder system intakes live perceptual information related …

Qualcomm Snapdragon 845 Soc Supports 4K HDR video ...

Dec 06, 2017· Qualcomm says that the smarphones powered by the Snapdragon 845 will score above 100 on DxOMark (photpgraphy performance). Snapdragon 845's camera features also include deep portrait, multi-frame noise reduction, 30 percent power reduction for video, depth based face recognition, accelerated image stabilization, and more.

Low Complexity Video Compression Using Moving Edge ...

DCT based foveation fllter is used to reduce complexity for detecting foveation regions. For implementing low complexity encoders, a coding paradigm named dis-tributed video coded (DVC) based on Wyner-Ziv [8] and Slepian-Wolf [9] infor-mation theory has …

Foveation image coding with fuzzy-based joint parameter ...

The foveation image/video processing is based on the fact that the spatial resolution of the HVS is highest around the foveation points and decreases rapidly with increasing eccentricity. Therefore, it is reasonable to allocate more bits to the image regions, where the human eyes are most sensitive, whereas allocates less bits to the image ...

Real-time foveation techniques for low bit rate video ...

Then, we demonstrate that foveation, as described by this model, can be incorporated into standard motion compensation and discrete cosine transform (DCT)-based video coding techniques for low bit rate video coding, such as the H.263 or MPEG-4 video coding standards, without incurring prohibitive complexity overhead.

Foveated video compression with optimal rate control ...

Foveated Video Compression with Optimal Rate Control Sanghoon Lee, Marios S. Pattichis, and Alan Conrad Bovik, Fellow, IEEE Abstract— Recently, foveated video compression algorithms have been proposed which, in certain applications, deliver high-quality video at reduced bit rates by seeking to match the nonuniform sampling of the human retina.

Foveation-based Mechanisms Alleviate Adversarial Examples ...

A foveation based method was proposed by Luo et al. [29] which shows robustness against weak attacks like L-BFGS [11] and FGSM [12]. Other closely related work to ours is that of Prakash et al ...

Multi-resolution foveation for bandwidth reduction of ...

Aug 24, 2010· Multi-resolution foveation for bandwidth reduction of moving images ... Adaptive resolution system and method for providing efficient low bit rate transmission of image data for distributed applications: ... in live event applications, the video may be compressed in real-time based on the eye behavior of the sample of viewers 32. Thus, ...