Citation Guide and Bibliography#

If you use plenoptic in a published academic article or presentation, please cite both the code by the DOI (for the specific version you used) as well as the current publication, Duong et al., 2023. You can use the following:

  • Most recent version of code: DOI

    • See zenodo for DOIs for older versions of the code.

  • Paper:

    @article{duong2023plenoptic,

title={Plenoptic: A platform for synthesizing model-optimized visual stimuli},
author={Duong, Lyndon and Bonnen, Kathryn and Broderick, William and Fiquet, Pierre-{'E}tienne and Parthasarathy, Nikhil and Yerxa, Thomas and Zhao, Xinyuan and Simoncelli, Eero},
journal={Journal of Vision},
volume={23},
number={9},
pages={5822--5822},
year={2023},
publisher={The Association for Research in Vision and Ophthalmology}
}

Additionally, please cite the following paper(s) depending on which component you use:

Note that, the citations given above define the application of the relevant idea (“metamers”) to computational models of the visual system that are instantiated in the algorithms found in plenoptic, but that, for the most part, these general concepts were not developed by the developers of plenoptic or the Simoncelli lab and are, in general, much older – the idea of metamers goes all the way back to Helmholtz, 1852! The papers above generally provide some discussion of this history and can point you to further reading, if you are interested.

Bibliography#

[1] (1,2)

A Berardino, V Laparra, J Ballé, and E P Simoncelli. Eigen-distortions of hierarchical representations. In I Guyon, UV Luxburg, S Bengio, H Wallach, R Fergus, S Vishwanathan, and R Garnett, editors, Adv. Neural Information Processing Systems (NIPS*17), volume 30, 1–10. Curran Associates, Inc., Dec 2017. Presented at: Neural Information Processing Systems 30, Dec 2017, Long Beach, CA.

[2]

William F Broderick, Gizem Rufo, Jonathan Winawer, and Eero P Simoncelli. Foveated metamers of the early visual system. eLife, October 2025. URL: http://dx.doi.org/10.7554/eLife.90554.2, doi:10.7554/elife.90554.2.

[3]

Arturo Deza, Aditya Jonnalagadda, and Miguel P. Eckstein. Towards metamerism via foveated style transfer. In International Conference on Learning Representations. 2019. URL: https://openreview.net/forum?id=BJzbG20cFQ.

[4]

Lyndon Duong, Kathryn Bonnen, William Broderick, Pierre-Étienne Fiquet, Nikhil Parthasarathy, Thomas Yerxa, Xinyuan Zhao, and Eero Simoncelli. Plenoptic: a platform for synthesizing model-optimized visual stimuli. June 2023. doi:10.1167/jov.23.9.5822.

[5]

Jenelle Feather, Alex Durango, Ray Gonzalez, and Josh McDermott. Metamers of neural networks reveal divergence from human perceptual systems. In NeurIPS, 10078–10089. 2019.

[6]

Jeremy Freeman and Eero P Simoncelli. Metamers of the ventral stream. Nature Neuroscience, 14(9):1195–1201, aug 2011. arXiv:PMC3164938, doi:10.1038/nn.2889.

[7]

H. Helmholtz. Lxxxi. on the theory of compound colours. The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science, 4(28):519–534, 1852. URL: https://doi.org/10.1080/14786445208647175, doi:10.1080/14786445208647175.

[8]

B. Julesz. Visual pattern discrimination. IEEE Transactions on Information Theory, 8(2):84–92, feb 1962. URL: http://dx.doi.org/10.1109/tit.1962.1057698, doi:10.1109/tit.1962.1057698.

[9]

Valero Laparra, Johannes Ballé, Alexander Berardino, and Eero P Simoncelli. Perceptual image quality assessment using a normalized laplacian pyramid. Electronic Imaging, 28(16):1–6, feb 2016. URL: http://dx.doi.org/10.2352/issn.2470-1173.2016.16.hvei-103, doi:10.2352/issn.2470-1173.2016.16.hvei-103.

[10]

Valero Laparra, Alexander Berardino, Johannes Ballé, and Eero P. Simoncelli. Perceptually optimized image rendering. Journal of the Optical Society of America A, 34(9):1511, aug 2017. URL: https://doi.org/10.1364\ \%2Fjosaa.34.001511, doi:10.1364/josaa.34.001511.

[11]

Jerome Y. Lettvin. On seeing sidelong. The Sciences, 16(4):10–20, jul 1976. URL: https://doi.org/10.1002%2Fj.2326-1951.1976.tb01231.x, doi:10.1002/j.2326-1951.1976.tb01231.x.

[12] (1,2)

Javier Portilla and Eero P Simoncelli. A parametric texture model based on joint statistics of complex wavelet coefficients. International journal of computer vision, 40(1):49–70, 2000.

[13] (1,2)

E P Simoncelli and W T Freeman. The steerable pyramid: A flexible architecture for multi-scale derivative computation. In Proc 2nd IEEE Int'l Conf on Image Proc (ICIP), volume III, 444–447. Washington, DC, Oct 23-26 1995. IEEE Sig Proc Society. doi:10.1109/ICIP.1995.537667.

[14]

E P Simoncelli, W T Freeman, E H Adelson, and D J Heeger. Shiftable multi-scale transforms. IEEE Trans. Information Theory, 38(2):587–607, Mar 1992. Special Issue on Wavelets. doi:10.1109/18.119725.

[15]

Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus. Intriguing properties of neural networks. ArXiv e-prints, pages 1–10, dec 2013. arXiv:1312.6199.

[16]

Thomas SA Wallis, Christina M Funke, Alexander S Ecker, Leon A Gatys, Felix A Wichmann, and Matthias Bethge. Image content is more important than bouma's law for scene metamers. eLife, apr 2019. URL: https://doi.org/10.7554/elife.42512, doi:10.7554/elife.42512.

[17] (1,2)

Z Wang and E P Simoncelli. Maximum differentiation (MAD) competition: A methodology for comparing computational models of perceptual discriminability. Journal of Vision, 8(12):1–13, Sep 2008. arXiv:PMC4143340, doi:10.1167/8.12.8.

[18]

Z. Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4):600–612, apr 2004. URL: https://doi.org/10.1109 \%2Ftip.2003.819861, doi:10.1109/tip.2003.819861.

[19]

Z. Wang, E.P. Simoncelli, and A.C. Bovik. Multiscale structural similarity for image quality assessment. In The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003. IEEE, 2003. URL: https://doi.org/10.1109/acssc.2003.1292216, doi:10.1109/acssc.2003.1292216.

[20]

Corey M. Ziemba and Eero P. Simoncelli. Opposing effects of selectivity and invariance in peripheral vision. Nature Communications, jul 2021. URL: https://doi.org/10.1038/s41467-021-24880-5, doi:10.1038/s41467-021-24880-5.

[21]

A. Rosenfeld, R. Zemel, and J. K. Tsotsos. The Elephant in the Room. ArXiv e-prints, aug 2018. arXiv:1808.03305.

On this page