New: "GEFF: Improving Any Clothes-Changing Person ReID Model using Gallery Enrichment with Face Features" presented at the RWS Workshop, WACV 2024.
New: "Taming Normalizing Flows" presented at WACV 2024.
New: "Deep Image Fingerprint: Towards Low Budget Synthetic Image Detection and Model Lineage Analysis" presented at WACV 2024.
New: "Diffusing Colors: Image Colorization with Text Guided Diffusion" presented at SIGGRAPH Asia 2023.
New: "Break-A-Scene: Extracting Multiple Concepts from a Single Image" presented at SIGGRAPH Asia 2023.
New: "Blended Latent Diffusion" presented at SIGGRAPH 2023 (journal track).
New: "SpaText: Spatio-Textual Representation for Controllable Image Generation" presented at CVPR 2023.
New: "Ham2Pose: Animating Sign Language Notation into Pose Sequences" presented at CVPR 2023.

About Me

I am a senior lecturer (assistant professor) of computer science at Reichman University. Prior to that, I was a postdoctoral research scholar at Stanford University, working with Prof. Maneesh Agrawala. For my PhD I worked with Prof. Adam Finkelstein as part of the Princeton Graphics group. I hold an M.Sc. in Computer Science and a B.Sc. in Computational Biology, both from The Hebrew University. My work lies in the intersection of computer graphics, computer vision, and HCI. More specifically, my research focuses on tools, algorithms, and new paradigms for photo and video editing and synthesis.

Preprints

E. Levin and O. Fried.
Differential Diffusion: Giving Each Pixel Its Strength.
arXiv, 2023.
[webpage] [pdf] [code] [colab] [demo]

Publications

S. Malnick, S. Avidan and O. Fried.
Taming Normalizing Flows.
WACV, 2024.
[webpage] [pdf] [code]
S. Sinitsa and O. Fried.
Deep Image Fingerprint: Towards Low Budget Synthetic Image Detection and Model Lineage Analysis.
WACV, 2024.
[webpage] [pdf] [code]
D. Arkushin, B. Cohen, S. Peleg and O. Fried.
GEFF: Improving Any Clothes-Changing Person ReID Model using Gallery Enrichment with Face Features.
RWS Workshop, WACV, 2024.
[webpage] [pdf] [code]
N. Zabari, A. Azulay, A. Gorkor, T. Halperin and O. Fried.
Diffusing Colors: Image Colorization with Text Guided Diffusion.
SIGGRAPH Asia, 2023.
[webpage] [pdf]
O. Avrahami, K. Aberman, O. Fried, D. Cohen-Or and D. Lischinski.
Break-A-Scene: Extracting Multiple Concepts from a Single Image.
SIGGRAPH Asia, 2023.
[webpage] [pdf] [code] [video]
O. Avrahami, O. Fried and D. Lischinski.
Blended Latent Diffusion.
ACM Transactions on Graphics (Proc. SIGGRAPH), 2023.
[webpage] [pdf] [code]
O. Avrahami, T. Hayes, O. Gafni, S. Gupta, Y. Taigman, D. Parikh, D. Lischinski, O. Fried and X. Yin.
SpaText: Spatio-Textual Representation for Controllable Image Generation.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
[webpage] [pdf]
R. Shalev-Arkushin, A. Moryossef and O. Fried.
Ham2Pose: Animating Sign Language Notation into Pose Sequences.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
[webpage] [pdf] [code]
D. Dadon, O. Fried and Y. Hel-Or.
DDNeRF: Depth Distribution Neural Radiance Fields.
WACV, 2023.
[webpage] [pdf] [code]
O. Avrahami, D. Lischinski and O. Fried.
GAN Cocktail: mixing GANs without dataset access.
ECCV, 2022.
[webpage] [pdf] [code]
A. Karnieli, O. Fried and Y. Hel-Or.
DeepShadow: Neural Shape from Shadow.
ECCV, 2022.
[webpage] [pdf] [code]
O. Avrahami, D. Lischinski and O. Fried.
Blended Diffusion for Text-driven Editing of Natural Images.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[webpage] [pdf] [code]
A. Tewari, M. Byrasandra Ramalinga, X. Pan, O. Fried, M. Agrawala and C. Theobalt.
Disentangled3D: Learning a 3D Generative Model with Disentangled Geometry and Appearance from Monocular Images.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[webpage] [pdf]
J. L. E, K. Y. Zhai, J. Echevarria, O. Fried, P. Hanrahan and J. A. Landay.
Dynamic Guidance for Decluttering Photographic Compositions.
ACM User Interface Software and Technology Symposium (UIST), 2021.
[webpage] [video (presentation)] [video (short)] [video (shorter)] [pdf]
A. Tewari, O. Fried, J. Thies, V. Sitzmann, S. Lombardi, Z. Xu, T. Simon, M. Nießner, E. Tretschk, L. Liu, B. Mildenhall, P. Srinivasan, R. Pandey, S. Orts-Escolano, S. Fanello, M. Guo, G. Wetzstein, J.-Y. Zhu, C. Theobalt, M. Agrawala, D. B Goldman and M. Zollhöfer.
Advances in Neural Rendering.
ACM SIGGRAPH Courses, 2021.
[webpage] [video-1] [video-2]
T. Halperin, H. Hakim, O. Vantzos, G. Hochman, N. Benaim, L. Sassy, M. Kupchik, O. Bibi and O. Fried.
Endless Loops: Detecting and Animating Periodic Patterns in Still Images.
ACM Transactions on Graphics (Proc. SIGGRAPH), 2021.
[webpage] [video] [blog]
X. Yao, O. Fried, K. Fatahalian and M. Agrawala.
Iterative Text-based Editing of Talking-heads Using Neural Retargeting.
ACM Transactions on Graphics, 2021.
[webpage] [video] [pdf] [supp]
R. Or-El, S. Sengupta, O. Fried, E. Shechtman and I. Kemelmacher-Shlizerman.
Lifespan Age Transformation Synthesis.
ECCV, 2020.
[webpage] [pdf] [dataset] [code] [colab notebook] [bib]
S. Agarwal, H. Farid, O. Fried and M. Agrawala.
Detecting Deep-Fake Videos from Phoneme-Viseme Mismatches.
CVPR Workshop on Media Forensics, 2020
[pdf] [bib]
A. Tewari*, O. Fried*, J. Thies*, V. Sitzmann*, S. Lombardi, K. Sunkavalli, R. Martin-Brualla, T. Simon, J. Saragih, M. Nießner, R. Pandey, S. Fanello, G. Wetzstein, J.-Y. Zhu, C. Theobalt, M. Agrawala, E. Shechtman, D. B Goldman and M. Zollhöfer. (* equal contribution)
State of the Art on Neural Rendering.
Computer Graphics Forum (Eurographics STAR report), 2020
[pdf] [talk] [bib]
J. L. E, O. Fried, J. Lu, J. Zhang, R. Mech, J. Echevarria, P. Hanrahan and J. A. Landay.
Adaptive Photographic Composition Guidance.
CHI, 2020
[webpage] [pdf] [video] [talk] [bib]
O. Fried, J. Jacobs, A. Finkelstein and M. Agrawala.
Editing Self Image.
Communications of the ACM, 2020
[pdf] [bib]
O. Fried, A. Tewari, M. Zollhöfer, A. Finkelstein, E. Shechtman, D. B Goldman, K. Genova, Z. Jin, C. Theobalt and M. Agrawala.
Text-based Editing of Talking-head Video.
ACM Transactions on Graphics (Proc. SIGGRAPH), 2019
[webpage] [pdf] [video] [bib]
J. L. E, O. Fried and M. Agrawala.
Optimizing Portrait Lighting at Capture-Time Using a 360 Camera as a Light Probe.
ACM User Interface Software and Technology Symposium (UIST), 2019
[pdf] [webpage (supplementary material, visualizations)] [video] [talk] [bib]
O. Fried and M. Agrawala.
Puppet Dubbing.
The 30th Eurographics Symposium on Rendering (EGSR), 2019
[pdf] [video] [results] [bib]
D. Danon, H. Averbuch-Elor, O. Fried and D. Cohen-Or.
Unsupervised Natural Image Patch Learning.
Computational Visual Media, 2019. Best paper award.
[pdf] [bib]
B. Ward, M. Ward, O. Fried and B. Paskhover.
Nasal Distortion in Short-Distance Photographs: The Selfie Effect.
JAMA Facial Plastic Surgery, 2018
[pdf] [bib]

O. Fried and B. Paskhover.
Perceived Facial Distortions in Selfies Are Explained by Viewing Habits—Reply.
JAMA Facial Plastic Surgery, 2018
[pdf] [bib]
O. Fried, S. Avidan and D. Cohen-Or.
Patch2Vec: Globally Consistent Image Patch Representation.
Computer Graphics Forum (Proc. Pacific Graphics), 2017
[pdf] [video] [supp] [bib]
O. Fried.
Photo Manipulation, The Easy Way.
PhD Dissertation, Princeton University, 2017 [pdf] [bib]
O. Fried, E. Shechtman, D. B Goldman and A. Finkelstein.
Perspective-aware Manipulation of Portrait Photos.
ACM Transactions on Graphics (Proc. SIGGRAPH), 2016
[webpage] [pdf] [video] [bib]
H. Chang, O. Fried, Y. Liu, S. DiVerdi and A. Finkelstein.
Palette-based Photo Recoloring.
ACM Transactions on Graphics (Proc. SIGGRAPH), 2015
[pdf] [video] [demo] [webpage] [bib]
O. Fried, E. Shechtman, D. B Goldman and A. Finkelstein.
Finding Distractors In Images.
28th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
[pdf] [video] [webpage] [data] [code] [popular-science-article] [bib]
O. Fried, S. DiVerdi, M. Halber, E. Sizikova and A. Finkelstein.
IsoMatch: Creating Informative Grid Layouts.
36th Annual Conference of the European Association for Computer Graphics (Eurographics), 2015
[pdf] [video] [code] [bib]
O. Fried, Z. Jin, R. Oda and A. Finkelstein.
AudioQuilt: 2D Arrangements of Audio Samples using Metric Learning and Kernelized Sorting.
14th International Conference on New Interfaces for Musical Expression (NIME), 2014
[pdf] [video] [bib]
O. Fried, and R. Fiebrink.
Cross-modal Sound Mapping Using Deep Learning.
Proc. New Interfaces for Musical Expression (NIME), 2013
[pdf] [video] [bib]
O. Fried.
Texture Synthesis for Particle Infused Textures.
Masters Thesis, The Hebrew University of Jerusalem, Israel, 2012
[pdf]
O. Fried.
Single-cell Resolution Analysis of Yeast Response to Osmo-Stress.
Undergrad Thesis, The Hebrew University of Jerusalem, Israel, 2010

Tutorials

A. Tewari*, O. Fried*, J. Thies*, V. Sitzmann*, S. Lombardi, K. Sunkavalli, R. Martin-Brualla, T. Simon, J. Saragih, M. Nießner, R. Pandey, S. Fanello, G. Wetzstein, J.-Y. Zhu, C. Theobalt, M. Agrawala, E. Shechtman, D. B Goldman and M. Zollhöfer. (* equal contribution)
Neural Rendering.
CVPR Tutorial, 2020
[webpage] [morning session] [afternoon session]

Media Coverage

Creating Accessible Solutions To Real-life Problems With Machine Learning. [Herzliyan]

"Two Minute Papers" highlighted several of our research projects throughout the years.

Deepfakes as a force for good (while being mindful of potential misuse). [digitaltrends]

Our YouTube video reached 350,000 views! (For a technical research video with no cats nor babies...)

Our work on Text-based Editing of Talking-head Video (2019) received some media attention. While I would have liked to see more on the exciting legitimate use cases, most stories focus on the fake-news angle (which is to be expected given the current political climate.) Hopefully this will help highlight the current issues with video authentication and more broadly, with misinformation.
[Stanford] [Washington Post] [Vice] [Fox News] [The Verge] [WorldStarHipHop] [Mashable] [Daily Mail] [The Register] [Business Insider] [TNW] [Observer] [Dazed] [ynet (he)] and more:
[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32].

Another interesting read that mentions our research: [Washington Post].

Wired video on photography, referencing some of our past research: [video].

Our research letter in JAMA Facial Plastic Surgery received some media attention! As of April 6, 2018, it has the #1 Altmetric score in JAMA Facial Plastic Surgery (#1 of 566) and is in the top 0.02% of all outputs tracked by Altmetric (#2219 of 9,569,234). [Altmetric]

Nasal Distortion in Short-Distance Photographs: The Selfie Effect (2018)
[CNN] [The Washington Post] [CBS News] [Forbes] [Wired] [The Verge] [ABC] [Newsweek] [Vox] [Daily Mail] [cnet] and many more:
[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138].

Face Warp, Art of Science (2017)
[PAW]

Radio story on the future of media manipulation (2017, in German)
[webpage] [mp3]

Perspective-aware Manipulation of Portrait Photos (2016)
[Gizmodo] [Motherboard] [Lonely Planet] [Forbes] [CNN] [FastCompany] [CACM] [DPReview] [DailyMail] [Yahoo Tech] [Digital Trends] [Gizmag] [Wired DE] [Spiegel] [PetaPixel] [TOI] [Science 2.0] [cnet] [NJ] [DIYPhotography] [designboom] [Fstoppers] [Inverse] [Princeton] [ICSJ] [Two Minute Papers]

Finding Distractors In Images (2015)
[Popular Science] [MSN] [Daily Mail] [Princeton] [IBT] [Yahoo] [ephotozine]
[Adobe MAX (video)] [TNW] [Inverse] [PAW]

Exposed, Art of Science (2013)
[Wired] [Popular Science] [Princeton] [National Geographic] [Gizmodo] [LiveScience] [Maxisciences]

Grants, Awards & Honors

[RUni ] Outstanding faculty researcher, CS department, 2022.
[RUni ] Israel Science Foundation, personal research grant (4 years), 2021.
[RUni ] Industry grant, Lightricks Ltd.
[Post ] The Brown Institute for Media Innovation, Fellow 2017-2019
[Post ] The Brown Institute for Media Innovation, Magic Grant 2018-2019
[Post ] The Brown Institute for Media Innovation, Magic Grant 2017-2018
[Ph.D.] Siebel Scholar, Class of 2017
[Ph.D.] Google PhD Fellowship, 2014-2016
[Ph.D.] Gordon Y.S. Wu Fellowship in Engineering, 2012-2013
[M.S. ] Scholarship of excellence, School of Computer Science, The Hebrew University, 2010-2011
[B.Sc.] Graduated magna cum laude
[B.Sc.] Amirim interdisciplinary honors program, 2007-2010
[B.Sc.] Scholarship of excellence, The Hebrew University, 2007-2010
[B.Sc.] Dean's list for 2007/8, 2008/9 and 2009/10

Patents

Image Distractor Detection and Processing, US9665962 B2
Optimizing Photo Album Layouts, US9424671 B1

Teaching

Reichman University — "Advanced Programming", fall 2020, fall 2021, fall 2022, fall 2023
Reichman University — "The Computer As A Content Creator", spring 2023
Reichman University — "Advanced Seminar on Virtual Humans", spring 2022
Reichman University — "Advanced Seminar on Neural Rendering", spring 2021
Stanford University — "Computational Video Manipulation", spring 2019
Princeton University — Teaching Assistant, "Computer Graphics", spring 2013
Princeton University — Teaching Assistant, "Computer Vision", fall 2013
Princeton University — Teaching Assistant, "MATLAB short course on programming", fall 2013
Hebrew University of Jerusalem — "Introduction to Software and System Security", fall 2011/12
Hebrew University of Jerusalem — "Introduction to Software and System Security", spring 2011

Service

SIGGRAPH Technical Papers Committee 20222023
Technical Papers Reviewer 20152017, 20192024
Posters Adjunct Committee 2017
General Program Reviewer 2016
Posters Reviewer 2016
SIGGRAPH Asia Technical Papers Committee 2024
Reviewer 20182023
Israel Science Foundation (ISF) Reviewer 20222023
WACV Reviewer 2023
CVPR Reviewer 20172020 (outstanding reviewer), 2022
ICLR Reviewer 2022
UIST Reviewer 20212022
Transactions on Visualization and Computer Graphics Reviewer 2022
ICCV Reviewer 2017, 2021
TPAMI Reviewer 2021
ECCV Reviewer 2018, 2020
Computer Graphics Forum Reviewer 20152016, 2019
Transactions on Graphics Reviewer 2016, 2018
Transactions on Applied Perception Reviewer 2018
International Journal of Human-Computer Interaction Reviewer 2018
The Visual Computer Reviewer 2017
Transactions on Multimedia Reviewer 2017
Transactions on Image Processing Reviewer 2016

Students

Omri Avrahami (with Dani Lischinski).
Shimon Malnick (with Shai Avidan).
Serge Sinitsa.
Rotem Shalev (with Amit Bermano).
Dan Botchan (with Yacov Hel-Or).
Omer David.
Almog Friedlander.
Eyal Michaeli.
Gal Almog (with Ariel Shamir).

Graduated:

Eran Levin (with Amir Averbuch).
Asaf Karnieli (with Yacov Hel-Or).
Dudi Dadon (with Yacov Hel-Or).
Daniel Anderson (with Ariel Shamir).
Or Nachmias (with Ariel Shamir).
Gili Knafo.
Bar Cohen.