Update out of date packages on Azure Machine Learning Compute instance

philmarius-new 126 Reputation points
2020-08-28T10:02:32.077+00:00

Started up a STANDARD_D11_V2 cluster to run some notebooks on.

Wanted to use json_normalize from pandas: https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.json_normalize.html and I get the below error:

AttributeError: module 'pandas' has no attribute 'json_normalize'

Pandas seems to be out of date. Checked the installed version of pandas:

$ python
Python 3.6.9 |Anaconda, Inc.| (default, Jul 30 2019, 19:07:31) [GCC 7.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import pandas

>>> pandas.__version__

'0.23.4

Pandas is indeed out of date, the latest version is v1.1.1. Fired up a terminal to run:

conda update --all

On the azureml_py36 environment which I had selected to run the notebook on. It hangs on:

Solving environment: /

Went to update conda to see if that would help:

conda update conda

But I get this error:

PackageNotInstalledError: Package is not installed in prefix.
  prefix: /anaconda/envs/azureml_py36
  package name: conda

Which leads me to think this is not a typical installation of conda.

Would like to run the most up to date packages on Azure Machine Learning to replicate the local environment I have setup. Does anyone know how to do this?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,852 questions
0 comments No comments
{count} votes

Accepted answer
  1. romungi-MSFT 44,951 Reputation points Microsoft Employee
    2020-08-28T13:43:08.187+00:00

    @philmariusnew-9791 I have tried the above steps and the installation completed successfully for conda. But when we upgrade pandas azureml package has a dependency so it cannot use version v1.1.1

    I have went ahead and upgrade the pandas version but there is a warning as seen below:

    21216-image.png

    We would recommend to use the package that is compatible with azureml so your environment setup works as expected.


0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.