Dynamic saliency map for 3D content: one paper accepted in Cognitive Computation journal 2012
Video inpainting: one paper accepted at ICIP 2012
Special session on visual attention SPIE 2012 here NEW !
One paper accepted at ECCV 2012 (Super-resolution-based inpainting, demo Here) NEW !
One paper accepted in BRM journal (Similarity metrics for assessing the performance of computational models of visual attention) NEW !
here
We release the first version (V1.0) of BRM's software: visual fixation analysis here
NEW !
One paper accepted in Optics Letters (Saliency detection using regional histograms[pdf])
One paper accepted at ICIP'13 (Memorability of natural scene: the role of attention) [Here]) NEW !
One paper accepted in IEEE TIP (Hierarchical super-resolution-based inpainting) ([Here]) NEW !
Supplementary materials SPIE HVEI'13 paper (How visual attention is modified by disparities and textures changes?) ([Here])NEW !
Research Areas
Visual attention understanding and modelling: 3 research axis
Computational modelling of the visual attention:
From left to right: original picture, heat map and visual scan path (20 first fixation points).
Leçon d'anatomie, Rembrandt
Déjeuner sur l'herbe, Manet
eye tracking data set: here special session ICIP'09, SPIE'2012 : here
Relationship between visual fixations and scene context:
Would it be possible to categorize fixations as attentional fixations, semantic fixations...?
Is there a particular pattern of gaze deployment for a given scene?
Examining the gaze deployment under a quality assessment task: application to quality metric.
A. Ninassi, From local perception of coding distortions to the overall visual quality evaluation of images and video. Contribution of visual attention in visual quality assessment,
PhD thesis, university of Nantes, 2009.
Do video coding impairments disturb the visual attention deployment?, Elsevier, Signal Processing: Image Communication, 2010. [IF=0.836]
From left to right: Original, degraded pictures and saliency map (Click to get the full resolution picture.) [Project page] NEW !
Overt visual attention for free-viewing and quality assessment tasks. Impact of the regions of interest on a video quality metric., accepted in Elsevier, Signal Processing: Image Communication. [IF=0.836]
Saliency-based applications:
Perceptual/selective compression: some details in O. Le Meur et al. Selective H.264 video coding based on a saliency map, Not published, 2005. [pdf]
Content-aware image cropping:
The image is cropped based on a saliency map. The basic scheme, see below, illustrates the main idea:
More details in:
O. Le Meur, X. Castellan, P. Le Callet, D. Barba, Efficient saliency-based repurposing method,
ICIP, 2006. [pdf][poster]
C. Chamaret and O. Le Meur, Attention-based video reframing: validation using eye-tracking,
ICPR, 2008. [pdf]
Data-pruning based on saliency: Y. Andam, Master Thesis 2010. Below, an example based on Weickert's study. From the edges of a picture, the picture is reconstructed by using a diffusion scheme:
O. Le Meur, Attention sélective en visualisation d'images fixes et animées affichées sur écran: modèles et évaluation de performances - applications
, University of Nantes, 2005. [pdf]
Sensitivity of human visual attention to artifacts of coding: here
A. Ninassi, De la perception locale des distortions de codage à l'appréciation globale de la qualité visuelle des images et vidéos. Apport de l'attention visuelle dans le jugement de la qualité
, University of Nantes, 2009. [pdf][Home page] (PostDoc at ENSICAEN)
B. Follet, Ambient/focal visual fixations dichotomy in natural scene perception
, University of Paris VIII, 2012. [Phd defense pdf]
J. Gautier, A Dynamic Visual Attention Model for 2D and 3D conditions - Depth Coding and Inpainting-based Synthesis for Multiview Videos
, IRISA / University of Rennes I, 2012. [Phd thesis pdf][Home page]
Book Chapter
1. L. Morin, O. Le Meur, C. Guillemot, V. Jantet and J. Gautier, Synthèse de vues intermédiaire Chapter in Vidéo 3D: Capture, traitement et diffusion. Lucas L., Loscos C. et Remion Y. (Editors), Hermès, 2013.
Journals
15. O. Le Meur, M. Ebdelli and C. Guillemot, Hierarchical super-resolution-based inpainting and applications. accepted for publication in IEEE TIP.
[Project page]
[IF=3.042].
14. Z. Liu, O. Le Meur, S. Luo and L. Shen, Saliency detection using regional histograms, Optics Letters, Vol. 38, N°5, March 2013 [pdf][Results]
[IF=3.39].
13. O. Le Meur and T. Baccino, Methods for comparing scanpaths and saliency maps: strengths and weaknesses, Behavior Research Method, 2012 [IF=2.4].
[Project page]
12. J. Gautier and O. Le Meur, A time-dependent saliency model mixing center and depth bias for 2D and 3D viewing conditions, Cognitive Computation
2012, DOI: 10.1007/s12559-012-9138-3. [web page (paper)]
11. B. Follet, O. Le Meur and T. Baccino New insights on ambient and focal visual fixations using an automatic classification algorithm, i-Perception, vol. 2(6), pp. 592610 2011.
[i-perception][web page (paper)]
10. F. Urban, B. Follet, C. Chamaret, O. Le Meur and T. Baccino Medium spatial frequencies, a strong predictor of salience, Cognitive Computation: Volume 3, Issue 1, pages 37-47, 2011
DOI: 10.1007/s12559-010-9086-8 (Special issue on Saliency, Attention, Active Visual Search, and Picture Scanning). Springer LinkFull text Preprint.
9. B. Follet, O. Le Meur and T. Baccino Modeling visual attention on scenes, Studia Informatica Universalis, Vol. 8, Issue 4, pp. 150-167, 2010.
[pdf]
8. O. Le Meur, A. Ninassi, P. Le Callet and D. Barba
Do video coding impairments disturb the visual attention deployment?,
Elsevier, Signal Processing: Image Communication, vol. 25, Issue 8, pp. 597-609, September 2010. DOI information: 10.1016/j.image.2010.05.008 [preprint pdf] [IF=0.836]
[Project page] NEW !
7. O. Le Meur, A. Ninassi, P. Le Callet and D. Barba
Overt visual attention for free-viewing and quality assessment tasks. Impact of the regions of interest on a video quality metric,
Elsevier, Signal Processing: Image Communication, vol. 25, Issue 7, pp. 547-558, August 2010. DOI information: 10.1016/j.image.2010.05.006 [preprint pdf] [IF=0.836]
6. O. Le Meur and J.C. Chevet
Relevance of a feed-forward model of visual attention for goal-oriented and free-viewing tasks,
IEEE Trans. On Image Processing, vol. 19, No. 11, November 2010 pp. 2801-2813. DOI information: 10.1109/TIP.2010.2052262 [preprint pdf][IF=3.315]
5. O. Le Meur, S. Cloarec and P. Guillotel
Automatic content repurposing for Mobile applications,
SMPTE Motion Imaging journal, January/February 2010.
4. A. Ninassi, O. Le Meur, P. Le Callet and D. Barba
Considering temporal variations of spatial visual distortions in video quality assessment,
IEEE Journal of Selected Topics in Signal Processing, Special Issue On Visual Media Quality Assessment, 2009. [pdf]
3. O. Le Meur, P. Le Callet and D. Barba,
Predicting visual fixations on video based on low-level visual features,
Vision Research, Vol. 47/19 pp 2483-2498, Sept. 2007. [pdf] [IF=2.05]
2. O. Le Meur, P. Le Callet and D. Barba,
Construction dimages miniatures avec recadrage automatique basée sur un modèle perceptuel bio-inspiré,
Numéro spécial de la Revue Traitement du Signal (TS), Systèmes de traitement et d'analyse des Images, Vol.24, N°5, pp. 323-336, 2007. [pdf]
1. O. Le Meur, P. Le Callet, D. Barba and D. Thoreau, A coherent computational approach to model the bottom-up visual attention,
IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 28, N°5, May 2006. [pdf] [IF=4.3]
Conferences
2013
Z. Liu and O. Le Meur, Superpixel-based saliency detection, WIAMIS 2013.
S. Luo, Z. Liu, L. Li, X. Zou and O. Le Meur, Efficient saliency detection using regional color and spatial information, EUVIP, 2013 [pdf].
M. Mancas and O. Le Meur, Memorability of natural scene: the role of attention, ICIP 2013 [Project page].
C. Guillemot, M. Turkan, O. Le Meur and M. Ebdelli, Image inpainting using LLE-LDNR and linear subspace mappings, ICASSP 2013.
M. Ebdelli, O. Le Meur and C. Guillemot, Analysis of patch-based similarity metrics: application to denoising, ICASSP 2013.
D. Khaustova, J. Founier, E. Wyckens and O. Le Meur,
How visual attention is modified by disparities and textures changes?, SPIE HVEI 2013. [Acceptance Rate=xx%]
[pdf][presentation][Project page].
2012
O. Le Meur and C. Guillemot, Super-resolution-based inpainting, ECCV 2012. [Acceptance Rate=25%]
[pdf][poster][Masks and Pictures]
NEW !
M. Ebdelli, O. Le Meur and C. Guillemot, Loss Concealment Based on Video Inpainting for Robust Video Communication, EUSIPCO 2012. [Acceptance Rate=xx%]
[pdf][presentation] With video examples.
M. Ebdelli, C. Guillemot and O. Le Meur, Examplar-based video inpainting with motion-compensated neighbor embedding, ICIP 2012. [Acceptance Rate=xx%] [pdf]
J. Gautier, O. Le Meur and C. Guillemot, Efficient Depth Map Compression based on Lossless Edge Coding and Diffusion, PCS 2012.
[pdf][poster]
NEW !
2011
O. Le Meur, T. Baccino and A. Roumy, Prediction of the Inter-Observer Visual Congruency (IOVC) and application to image ranking, ACM Multimedia (long paper) 2011. [Acceptance Rate=17%]
[pdf][presentation][poster][Project page] NEW !
B. Follet, O. Le Meur and T. Baccino, Features of ambient and focal fixations on natural visual scenes, ECEM 2011.
[pdf]
O. Le Meur, Robustness and Repeatability of saliency models subjected to visual degradations, ICIP 2011.
[pdf].[pdf poster].
O. Le Meur, J. Gautier and C. Guillemot, Examplar-based inpainting based on local geometry, ICIP 2011. [Project page][pdf].[pdf poster].
J. Gautier, O. Le Meur and C. Guillemot, Depth-based image completion for View Synthesis, 3DTV Conf. 2011. [Acceptance Rate=??%] [pdf][Project page] NEW !
O. Le Meur, Predicting saliency using two contextual priors: the dominant depth and the horizon line,
IEEE International Conference on Multimedia & Expo (ICME 2011) 2011 [Acceptance Rate=30%] [pdf][poster][Project page]
2010
C. Chamaret, O. Le Meur and J.C. Chevet, Spatio-temporal combination of saliency maps and eye-tracking assessment of different strategies,
ICIP, pp. 1077-1080, 2010 [Acceptance Rate=47%] [pdf].[pdf poster].
C. Chamaret, O. Le Meur, P. Guillotel and J.C. Chevet, How to measure the relevance of a retargeting approach?, Workshop Media retargeting, ECCV 2010.
[pdf].[pdf presentation].
[Project page]
C. Chamaret, S. Godeffroy, P. Lopez and O. Le Meur, Adaptive 3D Rendering based on Region-of-Interest,
SPIE 2010 [pdf]
2009
O. Le Meur and P. Le Callet, What we see is most likely to be what matters: visual attention and applications,
ICIP, pp. 3085-3088, 2009 [pdf] [more here] [Acceptance Rate=45%]
2008
C. Chamaret and O. Le Meur, Attention-based video reframing: validation using eye-tracking,
ICPR, 2008. [pdf]
A. Ninassi, O. Le Meur, P. Le Callet, D. Barba, Which Semi-Local Visual Masking Model For Wavelet Based Image Quality Metric?,
ICIP, 2008. [pdf]
2007
A. Ninassi, O. Le Meur, P. Le Callet, D. Barba, Does where you gaze on an image affect your perception of quality? Applying visual attention to image quality metric,
ICIP, 2007. [pdf][oral presentation]
2006
A. Ninassi, O. Le Meur, P. Le Callet, D. Barba, Task impact on the visual attention in subjective image quality assessment,
EUSIPCO, 2006. [pdf][oral presentation]
O. Le Meur, X. Castellan, P. Le Callet, D. Barba, Efficient saliency-based repurposing method,
ICIP, 2006. [pdf][poster]
before 2006
O. Le Meur, P. Le Callet, D. Barba, D. Thoreau, A human visual model-based approach of the visual attention and performance evaluation
, SPIE HVEI, 2005. [pdf].
O. Le Meur, P. Le Callet, D. Barba, D. Thoreau, Modelisation spatio-temporelle de lattention visuelle, CORESA, 2005. [pdf].
O. Le Meur, P. Le Callet, D. Barba, D. Thoreau, E. Francois, From low level perception to high level perception, a coherent
approach for visual attention modeling, SPIE HVEI, 2004. [pdf].
O. Le Meur, P. Le Callet, D. Barba, D. Thoreau, Performance assessment of a visual attention system entirely based on a human vision modelling
, ICIP, 2004. [pdf][poster].
O. Le Meur, P. Le Callet, D. Barba, D. Thoreau, Bottom-up visual attention modeling : quantitative comparison of predicted saliency maps with observers eye-tracking data
, ECVP, 2004. [poster].
Not Published
1. O. Le Meur, P. Le Callet, D. Barba Selective H.264 video coding based on a saliency map, Not published. [pdf].