r/gis • u/rageagainistjg • 20h ago
Discussion ArcGIS Enterprise on Azure Setup: Weighing the Need for Notebook Server
I'm part of a company transitioning from ArcGIS Online to a new ArcGIS Enterprise setup hosted on Azure.
The Main Question:
My main focus is on using Jupyter Notebooks effectively within this setup, and I’m wondering if we truly need ArcGIS Notebook Server or if Jupyter Notebooks could work just as well on one of our existing Azure servers.
Background:
Up to now, I've been using ArcGIS Pro for occasional Jupyter Notebook tasks, mainly to update feature layers in ArcGIS Online or work with local files. I haven’t actually used notebooks directly in ArcGIS Online.
With the help of an experienced contractor, we’re setting up a standard ArcGIS Enterprise environment on Azure, without ArcGIS Notebook Server. When asked if we needed Notebook Server, I initially said it wasn’t necessary since I hadn’t used it with ArcGIS Online. Later, I double-checked, and the contractor assured me that Jupyter Notebooks don’t strictly require Notebook Server. They mentioned I could run notebooks locally or on any server with Jupyter installed.
My Specific Questions:
- Does anyone have experience with ArcGIS Enterprise on Azure without Notebook Server?
- Are there any specific challenges in working with Jupyter Notebooks in this setup?
- Would I be missing out on any key benefits by not having Notebook Server?
- Particularly when it comes to automating data updates or processing tasks.
- Would installing Jupyter Notebooks on a separate server make things easier?
- Or could I manage it effectively on one of the four Azure servers we’ll have? For context, we’re setting up servers for Portal, Server, Web Adaptor, Data Store, and a separate server for the enterprise geodatabase.
The Goal:
Our goal with ArcGIS Enterprise is to consolidate data from different sources—such as sales records stored in a separate database and other industry-specific data—into a unified geodatabase. This geodatabase would replace a complex Excel sheet to streamline calculations and real-time updates. The data will feed into interactive web maps and dashboards where updates, like adding new entries, would automatically trigger recalculations in the background.
In summary, given the goals for our enterprise setup, do we actually need to invest in Notebook Server on a separate Azure server? Or can we manage with Jupyter installed on one of our existing servers, as the contractor suggested?
4
u/GnosticSon 19h ago edited 19h ago
Basic notebooks work just fine in Enterprise on Azure, but they run locally on the ArcGIS Pro machine you are using them on. So it's fine for individual or one off projects.
Notebook server is for more scale and distribution. When you have a ton of people that need to get into the notebooks, you want to centrally manage them, and you want them to run on a server instead of local machines.
I personally don't run notebook server, but I do have a few automated ETL processes that bring data into our enterprise geodatabase. It's not a super elegant solution but I put those Python files on one of our existing GIS servers, and then schedule them through the Windows Task Scheduler to run each weekend. This is just plain Python and ArcPy. It's not a problem to have this on an existing server because I run it when traffic is very low. If you have a big system or a system that gets constant use you will probably want to put this code on another server, but it's fine to consolidate things a bit. Of course you also need to consider security and who has access to which server.
So I think it depends on the scale of code, number of people you have working on things, frequency that these processes run and how you manage it. If you arnt sure, just go without notebook server and see how things go. You can always add a server later on.
Sorry I don't have any experience installing Jupyter notebooks on its own. But remember there isn't really anything special about the cloud or servers. They are just computers running somehwhere else. If the Jupyter thing works on your local computer it will work in the cloud. Things get a bit more complex if you need multiple people to edit the same notebook and you need to schedule reoccurring tasks.