Neural Upflow: A Scene Flow Learning Approach To Increase The Apparent Resolution Of Particle-Based Liquids Bruno Roy, Pierre Poulin, and Eric Paquette, Proc. ACM Comput. Graph. Interact. Tech. Volume 4, Number 3, Article 40 (September 2021), 26 pages, 2021. Presented at the virtual Symposium on Computer Animation (SCA 2021).

Abstract

We present a novel up-resing technique for generating high-resolution liquids based on scene flow estimation using deep neural networks. Our approach infers and synthesizes small- and large-scale details solely from a low-resolution particle-based liquid simulation. The proposed network leverages neighborhood contributions to encode inherent liquid properties throughout convolutions. We also propose a particle-based approach to interpolate between liquids generated from varying simulation discretizations using a state-of-the-art bidirectional optical flow solver method for fluids in addition with a novel key-event topological alignment constraint. In conjunction with the neighborhood contributions, our loss formulation allows the inference model throughout epochs to reward important differences in regard to significant gaps in simulation discretizations. Even when applied in an untested simulation setup, our approach is able to generate plausible high-resolution details. Using this interpolation approach and the predicted displacements, our approach combines the input liquid properties with the predicted motion to infer semi-Lagrangian advection. We furthermore showcase how the proposed interpolation approach can facilitate generating large simulation datasets with a subset of initial condition parameters.

Keywords

Online version

Official published paper: https://doi.org/10.1145/3480147.

Pre-print version of the paper.

Additional material

Slides of the presentation.

Pre-print version of the video:

BibTeX entry

@InProceedings{2021:Roy,
author = {Roy, Bruno and Poulin, Pierre and Paquette, Eric},
title = {Neural UpFlow: A Scene Flow Learning Approach to Increase the Apparent Resolution of Particle-Based Liquids},
booktitle = {Proc. ACM Comput. Graph. Interact. Tech.},
volume = {4},
number = {3},
pages = {40:1--40:26},
year = {2021},
}