Photorealistic rendering of rain streaks with lighting and viewpoint effects is a challenging problem. Raindrops undergo rapid shape distortions as they fall, a phenomenon referred to as oscillations. Due to these oscillations, the reflection of light by, and the refraction of light through, a falling raindrop produce complex brightness patterns within a single motion-blurred rain streak captured by a camera or observed by a human. The brightness pattern of a rain streak typically includes speckles, multiple smeared highlights and curved brightness contours.
In this project, we develop a model for rain streak appearance that captures the complex interactions between the lighting direction, the viewing direction and the oscillating shape of the drop. Our model builds upon a raindrop oscillation model that has been developed in atmospheric sciences. We have measured rain streak appearances under a wide range of lighting and viewing conditions and empirically determined the oscillation parameters that are dominant in raindrops. The image shown above compares measured rain streaks with streaks rendered using our model, for different lighting and viewing directions. Using our model and estimated parameters, we have rendered thousands of rain streaks to create a database that captures the variations in streak appearance with respect to lighting and viewing directions. We have developed an efficient image-based rendering algorithm that uses our streak database to add rain to a single image or a captured video with moving objects and sources. Our rendering algorithm is very simple to use as it only requires a coarse depth map of the scene and the locations and properties of the light sources. Our rendering results show that the proposed physically-based rain streak model greatly enhances the visual realism of rendered rain.
This video shows rain rendered against a black background to highlight the variation in rain appearance with illumination direction. One can see the strong dependence of streak appearance on the illumination direction. We also compare our results with rain rendered using the commonly used constant-brightness streak model. When rain that is close to the camera is rendered using constant-brightness model it looks unrealistic as it fails to produce the complex streak patterns and the effects of changing illumination. (With narration)
Поделиться в:
Доступные форматы для скачивания:
Скачать видео mp4
Информация по загрузке:
Скачать аудио mp3
Похожие видео
array(10) {
[0]=>
object(stdClass)#4826 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "KC8s30clJSY"
["related_video_title"]=>
string(38) "Minimalist Vision with Freeform Pixels"
["posted_time"]=>
string(27) "9 месяцев назад"
["channelName"]=>
string(24) "Columbia Computer Vision"
}
[1]=>
object(stdClass)#4799 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "XesXSghOajg"
["related_video_title"]=>
string(38) "Cricket: A Self-Powered Chirping Pixel"
["posted_time"]=>
string(27) "5 месяцев назад"
["channelName"]=>
string(24) "Columbia Computer Vision"
}
[2]=>
object(stdClass)#4824 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "j_2Lmoit7Go"
["related_video_title"]=>
string(177) "лечебная музыка для сердца и сосудов 🌸 успокаивает нервную систему и радует душу, Нежная музыка"
["posted_time"]=>
string(0) ""
["channelName"]=>
string(15) "Relax Your Soul"
}
[3]=>
object(stdClass)#4831 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "lvM8DpYhFbo"
["related_video_title"]=>
string(184) "Музыка лечит сердце и сосуды🌸 Успокаивающая музыка восстанавливает нервную систему,расслабляющая"
["posted_time"]=>
string(0) ""
["channelName"]=>
string(15) "Yellow Melodies"
}
[4]=>
object(stdClass)#4810 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "ovx2pXKXh4Q"
["related_video_title"]=>
string(114) "Мой недельный эксперимент с Gemini и NotebookLM | Пошаговая инструкция"
["posted_time"]=>
string(23) "1 месяц назад"
["channelName"]=>
string(20) "Тата Mnogobukoff"
}
[5]=>
object(stdClass)#4828 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "jfKfPfyJRdk"
["related_video_title"]=>
string(47) "lofi hip hop radio 📚 beats to relax/study to"
["posted_time"]=>
string(0) ""
["channelName"]=>
string(9) "Lofi Girl"
}
[6]=>
object(stdClass)#4823 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "y-UtzzbV6UI"
["related_video_title"]=>
string(126) "⚡️Азербайджан пошёл против Путина || Лавров выдвинул условия стране"
["posted_time"]=>
string(23) "6 часов назад"
["channelName"]=>
string(23) "Время Прядко"
}
[7]=>
object(stdClass)#4833 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "2jF3GurBor8"
["related_video_title"]=>
string(165) "ЗА ПЕРЕВОДЫ на карту начали БЛОКИРОВАТЬ! Как избежать блокировки карты в 2025. НОВЫЕ правила"
["posted_time"]=>
string(23) "6 часов назад"
["channelName"]=>
string(12) "InvestFuture"
}
[8]=>
object(stdClass)#4809 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "MiaPRJw-bFo"
["related_video_title"]=>
string(46) "Best of Gibran Alcocer | Beautiful Ambient Mix"
["posted_time"]=>
string(19) "1 год назад"
["channelName"]=>
string(5) "BLUME"
}
[9]=>
object(stdClass)#4827 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "IHZwWFHWa-w"
["related_video_title"]=>
string(131) "Градиентный спуск, как обучаются нейросети | Глава 2, Глубинное обучение"
["posted_time"]=>
string(19) "7 лет назад"
["channelName"]=>
string(11) "3Blue1Brown"
}
}
