Deep Learning Studio doesn't start


#1

Message “Deep Learnig Sudio is starting” never ends

DLS version: 2.0.7
DLS manager version : 2.0.7

This is the LOG

Starting Deep Learning Studio...

Checking GPU support…
GPU not supported
skipping cifar dataset download!
skipping IMDB dataset download!
skipping MNIST dataset download!
skipping reuters dataset download!
No changes detected
Using MXNet backend.
D:\software\DeepLearningStudio\conda3\lib\site-packages\allauth\account\templatetags\account_tags.py:4: DeprecationWarning: {% load account_tags %} is deprecated, use {% load account %}
DeprecationWarning)
D:\software\DeepLearningStudio\conda3\lib\site-packages\allauth\socialaccount\templatetags\socialaccount_tags.py:4: DeprecationWarning: {% load socialaccount_tags %} is deprecated, use {% load socialaccount %}
" {% load socialaccount %}", DeprecationWarning


#2

The log seems incomplete. Are you sure this is the full log ?


#3

Thanks for the reply.
I agree, the log seems incomplete, but this is the the output the tool provide me.
I upload the screenshot of the log tab taken 1 hour after I press the start button.
How can I get a more detailed log to understand the cause of the problem?

immagine


#4

There are no more detailed logs.

Can you check your system RAM usage after starting Deep Learning Studio ? Maybe there is not enough RAM?


#5

Total RAM usage is less than 20%. The host has 16 GB.

Does DLS require specific open ports on the firewall? Could it be a communication problem?


#6

Yes, DLS requires some ports to be available (8000) and 8880 to 8890. But I doubt that the ports are an issue here. In case ports are not available, there is error message in the logs (as reported by other users).

Did you have any previous version installed ? One possibility of getting stuck at this point is that it is trying to upgrade the old database.

Could you rename <DLS_Install_location>\home\app\database\db.sqlite3 to some other name and start deep learning studio again ? (do stop deep learning studio before renaming)


#7

DLS version 2.0.7 is the first and only one I installed.

I tried renaming the db.sqlite file, but the problem remains.
I tried unistall and reinstall DLS using a different path but the problem persists
I tried install DLS using a different host, but the problem is the same.

Are there specific requirements in terms of Windows OS?

Thanks


#8

There are no specific requirements for Windows OS and so far I have not seen this issue with Deep Learning Studio.

You may want to look at the startup script and add some echo statements to pinpoint which command is getting stuck.

Startup script is located at <DLS_INSTALL_LOCATION>\home\app\start.sh

I believe it is getting stuck in running following command:

./manage.py makemigrations --noinput && ./manage.py migrate --noinput

Can you replace that above line with

echo "generating migrations"
./manage.py makemigrations --noinput
echo "migration generated. migrating"
./manage.py migrate --noinput
echo "migration done"

Try one more time without the --noinput argument to check if it is waiting for some input.


#9

This is the new log, the same with and without “–noinput”

Starting Deep Learning Studio…
Checking GPU support…
GPU not supported
skipping cifar dataset download!
skipping IMDB dataset download!
skipping MNIST dataset download!
skipping reuters dataset download!
generating migrations
No changes detected
Using MXNet backend.
D:\progr\DeepLearningStudio\conda3\lib\site-packages\allauth\account\templatetags\account_tags.py:4: DeprecationWarning: {% load account_tags %} is deprecated, use {% load account %}
DeprecationWarning)
D:\progr\DeepLearningStudio\conda3\lib\site-packages\allauth\socialaccount\templatetags\socialaccount_tags.py:4: DeprecationWarning: {% load socialaccount_tags %} is deprecated, use {% load socialaccount %}
" {% load socialaccount %}", DeprecationWarning)


#10

This is a strange behavior. The command ./manage.py makemigrations is not producing any error and seems to have stuck.

Today one of the user was also facing some strange behavior (unable to connect to compute server) which turned out to be caused by Anti-Virus.

Do you have Anti-virus on your system ? if so, can you try disabling it and check if it is able to proceed further.


#11

Thanks for the suggestion,
I tried to launch the tool by disabling the antivirus but the tool tool doesn’t work.

Could these messages be an issue?
D:\progr\DeepLearningStudio\conda3\lib\site-packages\allauth\account\templatetags\account_tags.py:4:
DeprecationWarning: {% load account_tags %} is deprecated, use {% load
account %}

DeprecationWarning)

D:\progr\DeepLearningStudio\conda3\lib\site-packages\allauth\socialaccount\templatetags\socialaccount_tags.py:4:
DeprecationWarning: {% load socialaccount_tags %} is deprecated, use {%
load socialaccount %}

" {% load socialaccount %}", DeprecationWarning)


#12

Those warnings are not the issue. They come even in a working environment.

You can try running that command manually from shell and see if you are getting error. If it is hanging, then press CTRL+C and it will reveal stack trace which may give some idea where it is stuck.

To launch it manually:

  1. start bash shell (double click on bash.exe in <DLS_INSTALL_FOLDER>\usr\bin)

  2. export few environment variables:

export PATH=/usr/bin:/conda3:$PATH
export PYTHONHOME=/conda3
export GPU_ENABLED=1
export HOME=/home/app
export PYTHONPATH=/home/app

  1. run the command
    cd /home/app
    ./manage.py makemigrations

#13

Setting the enviroment variables and running the command $ ./manage.py makemigrations the programm exits with this output

$ ./manage.py makemigrations
Traceback (most recent call last):
File “./manage.py”, line 29, in
execute_from_command_line(sys.argv)
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\core\managem
ent_init_.py”, line 367, in execute_from_command_line
utility.execute()
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\core\managem
ent_init_.py”, line 359, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\core\managem
ent\base.py”, line 294, in run_from_argv
self.execute(*args, **cmd_options)
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\core\managem
ent\base.py”, line 342, in execute
self.check()
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\core\managem
ent\base.py”, line 374, in check
include_deployment_checks=include_deployment_checks,
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\core\managem
ent\base.py”, line 361, in run_checks
return checks.run_checks(**kwargs)
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\core\checks
registry.py”, line 81, in run_checks
new_errors = check(app_configs=app_configs)
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\core\checks
urls.py”, line 14, in check_url_config
return check_resolver(resolver)
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\core\checks
urls.py”, line 24, in check_resolver
for pattern in resolver.url_patterns:
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\utils\functi
onal.py”, line 35, in get
res = instance.dict[self.name] = self.func(instance)
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\urls\resolve
rs.py”, line 313, in url_patterns
patterns = getattr(self.urlconf_module, “urlpatterns”, self.urlconf_module)
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\utils\functi
onal.py”, line 35, in get
res = instance.dict[self.name] = self.func(instance)
File “D:\progr\DeepLearningStudio\conda3\lib\site-packages\django\urls\resolve
rs.py”, line 306, in urlconf_module
return import_module(self.urlconf_name)
File "D:\progr\DeepLearningStudio\conda3\lib\importlib_init
.py", line 126,
in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File “”, line 986, in _gcd_import
File “”, line 969, in _find_and_load
File “”, line 958, in _find_and_load_unlocked
File “”, line 666, in _load_unlocked
File “”, line 577, in module_from_spec
File “”, line 906, in create_module
File “”, line 222, in _call_with_frames_removed
File “app\urls.py”, line 26, in init app.urls
File “project\views.py”, line 26, in init project.views
File “license\models.py”, line 37, in init license.models
FileNotFoundError: [Errno 2] No such file or directory: ‘/proc/1/cpuset’
Sentry is attempting to send 1 pending error messages
Waiting up to 10 seconds
Press Ctrl-Break to quit


#14

ok. This error is because of I missed to mention one environment variable. You need to set following variable as well:

export SESSION_ID=‘DLS’


#15

Ok thanks, now the program starts but does not end (CTRL + C does not seem to work).
I tried to run the program using pdb, it seems like an infinite loop. See the output below

This is the output of the first test:
$ ./manage.py makemigrations
Using MXNet backend.
D:\progr\DeepLearningStudio\conda3\lib\site-packages\allauth\account\templatetag
s\account_tags.py:4: DeprecationWarning: {% load account_tags %} is deprecated,
use {% load account %}
DeprecationWarning)
D:\progr\DeepLearningStudio\conda3\lib\site-packages\allauth\socialaccount\templ
atetags\socialaccount_tags.py:4: DeprecationWarning: {% load socialaccount_tags
%} is deprecated, use {% load socialaccount %}
" {% load socialaccount %}", DeprecationWarning)
No changes detected


Output using pdb:
$ python -m pdb manage.py makemigrations

d:\progr\deeplearningstudio\home\app\manage.py(9)()
-> import os
(Pdb) continue
Using MXNet backend.
D:\progr\DeepLearningStudio\conda3\lib\site-packages\allauth\account\templatetag
s\account_tags.py:4: DeprecationWarning: {% load account_tags %} is deprecated,
use {% load account %}
DeprecationWarning)
D:\progr\DeepLearningStudio\conda3\lib\site-packages\allauth\socialaccount\templ
atetags\socialaccount_tags.py:4: DeprecationWarning: {% load socialaccount_tags
%} is deprecated, use {% load socialaccount %}
" {% load socialaccount %}", DeprecationWarning)
No changes detected
The program finished and will be restarted
d:\progr\deeplearningstudio\home\app\manage.py(9)()
-> import os
(Pdb) continue
No changes detected
The program finished and will be restarted
d:\progr\deeplearningstudio\home\app\manage.py(9)()
-> import os
(Pdb) continue
No changes detected
The program finished and will be restarted
d:\progr\deeplearningstudio\home\app\manage.py(9)()
-> import os
(Pdb) continue
No changes detected
The program finished and will be restarted
d:\progr\deeplearningstudio\home\app\manage.py(9)()
-> import os
(Pdb)


#16

Hello, I have the exact same problem. My configuration is Windows 7 64 bit.

Maybe the problem is that I have Python 3.4.4 installed? what are the Python requirements for this project?


#17

There are no python requirements. Deep Learning Studio does not require any existing python installation.

In earlier versions, there was conflict with system python but that was resolved in later versions.

I am not sure why ./manage.py would get stuck.

You can try removing existing PYTHON from system PATH in case it is still interfering.


#18

I removed Python from the system path, but the issue still exists.

Starting Deep Learning Studio...

Checking GPU support…
GPU not supported
skipping cifar dataset download!
skipping IMDB dataset download!
skipping MNIST dataset download!
skipping reuters dataset download!
No changes detected
Using MXNet backend.
C:\Users\XXX\AppData\Local\Programs\DeepLearningStudio\conda3\lib\site-packages\allauth\account\templatetags\account_tags.py:4: DeprecationWarning: {% load account_tags %} is deprecated, use {% load account %}
DeprecationWarning)
C:\Users\XXX\AppData\Local\Programs\DeepLearningStudio\conda3\lib\site-packages\allauth\socialaccount\templatetags\socialaccount_tags.py:4: DeprecationWarning: {% load socialaccount_tags %} is deprecated, use {% load socialaccount %}
" {% load socialaccount %}", DeprecationWarning)


#19

I tried to install the new 2.1.0 version, but the problem still exists. May be Windows 7 64 bit the problem?

Checking GPU support…
GPU not supported
[14:47:27] downloading CIFAR dataset…
[14:57:44] Downloaded CIFAR dataset.
[14:57:45] downloading IMDB dataset…
[14:58:23] Downloaded IMDB dataset.
initiated datasets repo at: C:\Users\aaa\AppData\Local\Programs\DeepLearningStudio_new\home\app.pydataset/
Generated dataset: titanic
Generated dataset: iris
Pydatasets installed
[14:58:43] downloading MNIST dataset…
[15:09:01] Downloaded MNIST dataset.
[15:09:05] downloading reuters dataset…
[15:09:07] Downloaded reuters dataset.
Migrations for ‘automl’:
automl\migrations\0001_initial.py:
- Create model AutoMLModel
Migrations for ‘projects’:
projects\migrations\0001_initial.py:
- Create model Project
Migrations for ‘project’:
project\migrations\0001_initial.py:
- Create model dataModel
- Create model deepModel
- Create model importModel
- Create model paramsModel
- Create model testModel
- Create model trainingModel
Migrations for ‘environments’:
environments\migrations\0001_initial.py:
- Create model EnvironmentModel
Using MXNet backend.
C:\Users\aaa\AppData\Local\Programs\DeepLearningStudio_new\conda3\lib\site-packages\allauth\account\templatetags\account_tags.py:4: DeprecationWarning: {% load account_tags %} is deprecated, use {% load account %}
DeprecationWarning)
C:\Users\aaa\AppData\Local\Programs\DeepLearningStudio_new\conda3\lib\site-packages\allauth\socialaccount\templatetags\socialaccount_tags.py:4: DeprecationWarning: {% load socialaccount_tags %} is deprecated, use {% load socialaccount %}
" {% load socialaccount %}", DeprecationWarning)


#20

We have not tested on windows 7. So that could be the reason. We will try on a windows 7 system and see if we can reproduce it.