Skip to content

New model Fourier Reparametrization#6

Open
ImbriacoR wants to merge 5 commits into
kushalvyas:mainfrom
ImbriacoR:feature/fourier_reparametrized
Open

New model Fourier Reparametrization#6
ImbriacoR wants to merge 5 commits into
kushalvyas:mainfrom
ImbriacoR:feature/fourier_reparametrized

Conversation

@ImbriacoR
Copy link
Copy Markdown

Overview

This PR adds the model described in the paper "Improved Implicit Neural Representation with Fourier Reparameterized Training" by Shi et al. The current implementation allows construction of models using either the ReLU or SIREN nonlinearities.

Changes

Added a new Linear layer class for Fourier-based initialization.
Added tests and example notebook.

completed Fourier Reparametrization module for SIREN and ReLU
…ep models/nonlins/layers separate.

Added tests.
Removed unused imports.
@kushalvyas
Copy link
Copy Markdown
Owner

Hi @ImbriacoR ,
Thanks for contributing to Alpine! I will take a look at the PR and get back to you soon. If all looks good, I'll straight-up integrate it.

@ImbriacoR
Copy link
Copy Markdown
Author

Hi @kushalvyas,
Take your time and feel free to review the changes. Let me know if modifications are necessary, I tried to follow the existing code style but may have missed some things.

Copy link
Copy Markdown
Collaborator

@daniel360kim daniel360kim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @ImbriacoR,

Overall, this looks like a strong implementation of the FR-INR paper with solid test coverage.

I left a few suggestions around the InitType and NonlinClass abstractions to improve clarity and robustness. See inline comments for details.

Comment thread alpine/models/fourier_reparametrized.py Outdated
Comment thread alpine/models/fourier_reparametrized.py Outdated
Comment thread alpine/models/fourier_reparametrized.py Outdated
- Removed "linear" folder and moved FourierLayer into fourier_reparametrized.py
- Simplified model creation.
- Added additional test for nonlinearity error.
@ImbriacoR
Copy link
Copy Markdown
Author

Hi @daniel360kim,

I have gone over your review and applied all changes. Please let me know if any other changes are necessary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants