Motivation and goals
The Dataverse Containerization Working Group helps people run Dataverse in containers such as Docker. We aim to include many perspectives and use cases to make sure the Dataverse community’s needs are covered.
Where are the images? How do I get started?
You can find the our images here:
- Docker Hub: https://hub.docker.com/u/gdcc
- GitHub Container Registry (GHCR): https://github.com/orgs/gdcc/packages?ecosystem=container
You can give the images a try by following the quickstart for running Dataverse in a demo or evaluation environment. Images are also used in development environments for both the backend and frontend. Feedback is welcome!
For details about the images, please see the Dataverse Container Guide. You can also preview the guide for the next release.
Working group meetings
All are welcome to join our meetings! We meet on the first Thursday of the month at 9:30am Eastern Time (ET). Note below that we have an in-person meeting coming up!
The Zoom link is https://harvard.zoom.us/j/91061519853?pwd=U1lQR1ExMlo3Ty9XUVJIM2ZPNW1mdz09
We try to keep the meeting times below accurate but you can check the meetings topic in Zulip for reminders and any last minute changes.
- 2025-06-10, 14:00 Eastern meeting notes, in-person at the 2025 Dataverse Community Meeting in Chapel Hill, North Carolina, USA!
- 2025-06-05, 09:30 Eastern meeting notes
- 2025-05-08, 09:30 Eastern meeting notes, recording
- 2025-04-03, 09:30 Eastern meeting notes, recording
Older meetings
- 2025-03-06, 09:30 Eastern meeting notes, recording
- 2025-02-06, 09:30 Eastern meeting notes, recording
- 2025-01-30, 09:30 Eastern meeting notes, recording
- 2025-01-23, 09:30 Eastern meeting notes, recording
- 2025-01-16, 09:30 Eastern meeting notes, recording
- 2025-01-09, 09:30 Eastern meeting notes, recording
- 2024-12-05, 09:30 Eastern meeting notes, recording
- 2024-11-28 no meeting! 🦃
- 2024-11-21, 09:30 Eastern meeting notes, recording
- 2024-10-31, 09:30 Eastern meeting notes, recording
- 2024-10-24, 09:30 Eastern meeting notes, recording
- 2024-10-10, 09:30 Eastern meeting notes, recording
- 2024-09-26, 09:30 Eastern meeting notes, recording
- 2024-09-19, 09:30 Eastern meeting notes, recording
- 2024-09-12, 09:30 Eastern meeting notes, recording
- 2024-09-05 no meeting! Whale watch! 🐋
- 2024-08-29, 09:30 Eastern meeting notes, recording
- 2024-08-22, 09:30 Eastern meeting notes, recording
- 2024-08-15, 09:30 Eastern meeting notes, recording
- 2024-08-08, 09:30 Eastern meeting notes, recording
- 2024-08-01, 09:30 Eastern meeting notes, recording
- 2024-07-25, 09:30 Eastern meeting notes, recording
- 2024-07-18, 09:30 Eastern meeting notes, recording
- vacations and summer fun 🏖️
- 2024-06-06, 09:30 Eastern meeting notes, recording
- 2024-05-30, 09:30 Eastern meeting notes, recording
- 2024-05-23, 09:30 Eastern meeting notes, recording
- 2024-05-16, 09:30 Eastern meeting notes, recording
- 2024-05-09, 09:30 Eastern meeting notes, recording
- 2024-05-02, 09:30 Eastern meeting notes, recording
- 2024-04-25, 09:30 Eastern meeting notes, recording
- 2024-04-18, 09:30 Eastern meeting notes, recording
- 2024-04-11, 09:30 Eastern meeting notes, recording
- 2024-04-04 no meeting! Phil, Oliver, and Jan speaking at Distribits
- 2024-03-28, 09:30 Eastern meeting notes, recording
- 2024-03-21, 09:30 Eastern meeting notes, recording - special guest Christopher Tate from Red Hat
- 2024-03-14, 09:30 Eastern meeting notes, recording
- 2024-03-07, 08:00 CST meeting notes, recording - in-person at the 2024 Dataverse Community Meeting
- 2024-02-29, 09:30 Eastern meeting notes, recording
- 2024-02-22, 09:30 Eastern meeting notes, recording
- 2024-02-15, 09:30 Eastern meeting notes, recording
- 2024-02-08, 09:30 Eastern meeting notes, recording
- 2024-02-01, 09:30 Eastern meeting notes, recording
- 2024-01-25, 09:30 Eastern meeting notes, recording
- 2024-01-18, 09:30 Eastern meeting notes, recording
- 2024-01-11, 09:30 Eastern meeting notes, recording
- 2024-01-04, 09:30 Eastern meeting notes, recording
- No meetings! Happy holidays!
- 2023-12-14, 09:30 Eastern meeting notes, recording
- 2023-12-07, 09:30 Eastern meeting notes, recording
- 2023-11-30, 09:30 Eastern meeting notes, recording
- 2023-11-23 skipping! Happy Thanksgiving! 🦃
- 2023-11-16, 09:30 Eastern meeting notes, recording
- 2023-11-09, 09:30 Eastern meeting notes, recording
- 2023-11-02, 09:30 Eastern meeting notes, recording
- 2023-10-26, 09:30 Eastern meeting notes, recording
- 2023-10-19, 09:30 Eastern meeting notes, recording
- 2023-10-12, 09:30 Eastern meeting notes, recording
- 2023-10-05, 09:30 Eastern meeting notes, recording
- 2023-09-28, 09:30 Eastern meeting notes, recording
- 2023-09-21, 09:30 Eastern meeting notes, recording
- 2023-09-14, 09:30 Eastern meeting notes, recording
- 2023-09-07, 09:30 Eastern meeting notes, recording
- 2023-08-31, 09:30 Eastern meeting notes, recording
- 2023-08-24, 09:30 Eastern meeting notes, recording
- 2023-08-17, 09:30 Eastern meeting notes, recording
- 2023-08-10, 09:30 Eastern meeting notes, recording
- 2023-07-27, 09:30 Eastern meeting notes, recording
- 2023-07-20, 09:30 Eastern meeting notes, recording
- 2023-07-13, 09:30 Eastern meeting notes, recording
- 2023-06-15, 09:30 Eastern meeting notes, recording
- 2023-06-07 meeting (in person at #dataverse2023) notes
- 2023-05-25, 09:30 Eastern meeting notes, recording
- 2023-05-18, 09:30 Eastern meeting notes, recording
- 2023-05-11, 09:30 Eastern meeting notes, recording
- 2023-05-04, 14:00 UTC meeting notes, recording
- 2023-04-27, 14:00 UTC meeting notes, recording
- 2023-04-18, 15:00 UTC meeting (during the Dataverse Community Call) notes, recording
- 2023-04-13, 14:00 UTC meeting notes, recording
- 2023-04-06, 14:00 UTC meeting notes, recording
- 2023-03-30, 14:00 UTC meeting notes, recording
- 2023-03-23, 14:00 UTC meeting notes, recording
- 2023-03-21, 15:00 UTC kickoff (during the Dataverse Community Call) notes, recording
Getting in touch
If you can’t make it to a working group meeting, no worries! Please join us in the #containers channel in Zulip.
New features, bug fixes, and use cases 🎁
- 2025-03-20 File previewers have better docs: https://github.com/IQSS/dataverse/pull/11181
- 2025-03-20 Docs on loading metadata blocks and adjusting Solr to use them: https://github.com/IQSS/dataverse/pull/11204
- 2025-03-18 Dataverse 6.6 was released and our images on Docker Hub have been updated (alpha tag).
- 2025-03-10 SameSite cookie attribute set to “Lax”: https://github.com/IQSS/dataverse/pull/11210
- 2025-02-18 Docs added on customizing the root collection: https://github.com/IQSS/dataverse/pull/11201
- 2025-01-20 Container demo switched from FAKE DOI provider to Perma: https://github.com/IQSS/dataverse/pull/11108
- 2024-12-12 Dataverse 6.5 was released and our images on Docker Hub have been updated (alpha tag).
- 2024-11-15 File previewers are available in the “demo or eval” environment: https://github.com/IQSS/dataverse/pull/11025
- 2024-10-21 Docs on how to set up languages (English, French, etc.): https://github.com/IQSS/dataverse/pull/10940
- 2024-09-30 Dataverse 6.4 was released and our images on Docker Hub have been updated (alpha tag).
- 2024-09-20 Base images are now versioned: https://github.com/IQSS/dataverse/pull/10827
- 2024-07-03 Dataverse 6.3 was released and our images on Docker Hub have been updated (alpha tag).
- 2024-06-27: Upgrade to Payara 6.2024.6: https://github.com/IQSS/dataverse/pull/10495
- 2024-04-02 Dataverse 6.2 was released and our images on Docker Hub have been updated (alpha tag).
- 2024-03-38 Configuration of SMTP using MPCONFIG: https://github.com/IQSS/dataverse/pull/9939
- 2024-02-08 A tutorial has been written on running Dataverse in containers for demo or evaluation purposes.
- 2023-12-12 Dataverse 6.1 was released and our images on Docker Hub have been updated (alpha tag).
- 2023-11-07 Balázs Pataki figured out fast redeploy of Dataverse code to our containers, as discussed and documented, and further enhancements are being pursued in https://github.com/IQSS/dataverse/issues/9590.
- 2023-10-13 The docroot is now configurable so logos can now be uploaded to collections: https://github.com/IQSS/dataverse/pull/9819
- 2023-10-04 Testcontainers for integration testing: https://github.com/IQSS/dataverse/pull/9273 and https://dataverse-guide--9273.org.readthedocs.build/en/9273/developers/testing.html#writing-and-using-a-testcontainers-test and an example test
- 2023-08-28 Images with “unstable” tag updated to Solr 9: https://github.com/IQSS/dataverse/pull/9787
- 2023-08-23 Images with “unstable” tag updated to Java 17: https://github.com/IQSS/dataverse/pull/9764
- 2023-08-11 Images with “unstable” tag updated to Payara 6: https://github.com/IQSS/dataverse/pull/9685
- 2023-08-04 Images with “alpha” tag are now available (currently equivalent to 5.14): https://hub.docker.com/r/gdcc/dataverse/tags
- 2023-07-25 Experimental API test runner: https://github.com/pdurbin/dataverse-api-test-runner
- 2023-07-18 Frontend end to end tests are using containers. See https://github.com/IQSS/dataverse-frontend/pull/131
- 2023-06-23 Lots of documentation enhancements, fulfilling milestone A as well See PR#9584 and dev usage
- 2023-06-12 Container-based dev environment for the new React frontend. See docs, PR#87, and PR#112.
- 2023-06-01 Config Baker image to streamline tasks in Dataverse setup like bootstrapping. See Config Baker docs and PR#9574.
- 2023-05-08 Enable publishing preview application images to ghcr.io for pull requests from forks (
/push-image
). See PR#9575 for details. - 2023-04-25 Application images (Dataverse, not just the base image) are being pushed to registries (Docker Hub and GitHub Container Registry). See PR#9447 and related discussion.
- 2023-04-04 DOI JVM options can now be configured using MPCONFIG. See PR#8828.
- 2023-03-20 If you have Java and Maven installed, you can spin up Dataverse in Docker! See dev usage and PR#9439.
Roadmap
We presented a roadmap as a proposal with a series of milestones during the 2023-04-18 Dataverse Community Call (notes, recording):
- Milestone A: For backend (Java) developers (✅)
- Milestone B: For API client testing (✅)
- Milestone C: For an integration/frontend developer (w/o Java) (✅)
- Milestone D: Improve developer experience (80%)
- Migrate storage configuration to MPCONFIG (milestone D) #9998
- Milestone E: Demo or evaluation (60%)
- Milestone F: Demo with some configurability (50%)
- Milestone G: Run API tests in containers (40%)
In addition, we’ve been working on many issues as they come up. The best way to see what’s new (apart from joining meetings) is to check the “new features” list above, which serves as a changelog.
Since we aren’t strictly following the roadmap above, it’s best to consult the Containerization column of the Dataverse project board to see what we’re working on. Attending working group meetings (or checking notes or recordings) will give you a sense as well!
Links
- Dataverse Container Guide (pre-release preview)
- See especially the quickstart
- Containerization column within Dataverse project board (used for tracking activity).
- 2023 Dataverse Containerization Proposal/Roadmap
Prior containerization efforts
- Dataverse on K8s: gdcc/dataverse-kubernetes, k8s-docs.gdcc.io
- Derived: EOSC-synergy/dataverse-kubernetes
- Archive in a Box: IQSS/dataverse-docker
- Docker All In One (AIO): IQSS/dataverse/conf/docker-aio
- KU Leuven RDM Repository: libis/rdm-build
- LIP Computing: lip-computing/dataverse
- Patrick Carlson: PR 8709
- NDS Labs Service Catalog: nds-org/ndslabs-specs
Improving this website
Please feel free open an issue or create a pull request at https://github.com/gdcc/ct.gdcc.io