3.2.65 update now stuck LOADING

[draggaj]

Hi Dan,

I have just applied the 3.2.65 update and after restart of SIP, the gui is reporting the relays in LOADING state after login and no other clickable items on the home page operate. A reboot of the RPi has not recovered it and it remains in this stuck state.

Is there a way to rollback the update or recover from this situation? 
Has anyone else experienced this issue?
I can successfully ssh to the RPi ok, so if you need logs or configuration files to be able to debug this further, if that is required.
However, I will need to resolve this in the next couple of days, and i am prepared to rebuild if that is needed.
please advise.

Thanks
Bob    

[gary]

Similar problem here but seems to be related to loading any extra plugin. I did a clean install and tried to load any plugin (mqtt, weather_level_adj) and it goes into LOADING state. If I remove the plugin from the plugin directory restart and then the LOADING state clears but of course the plugin is missing from the manage plugin menu as expected. Running python 2.7.16 on RPi.

Thanks
Gary

[dan]

Ugg. Growing pains.

This has to do with the upgrade of SIP to Python 3 compatibility.

The plugins have been partially updated to run under Python3. It looks like the MQTT Plugin is causing the problem.

I will look into this today and report back here.

@ Bob, If you delete the mqtt plugin from the plugins folder SIP should run. If not please let me know what other plugins you have installed.

Dan

[dan]

It looks like the best way to deal with the change is to check out the Python3 development branch.
In the SIP directory use the command:
git checkout Py3_WIP

This will load the new version of SIP and should resolve the problems with the plugins. SIP can still run under python2 but is also capable of running under Python3 (with a slight change of renaming a folder)

Python2 will no longer be supported by the Python developers after January 1 2020.

Let me know if you are still having problems.

Dan

[draggaj]

It looks like the best way to deal with the change is to check out the Python3 development branch.
In the SIP directory use the command:
git checkout Py3_WIP

This will load the new version of SIP and should resolve the problems with the plugins. SIP can still run under python2 but is also capable of running under Python3 (with a slight change of renaming a folder)

Python2 will no longer be supported by the Python developers after January 1 2020.

Let me know if you are still having problems.

Dan

Ahah, brain fade by me. I also added the weather leve adjust plug in at the same time, which I omitted to mention.....so that is probably it... I have removed weather_level_adj.py and weather_level_adj.pyc from the /home/pi//SIP/plugins folder and rebooted.  Normality is restored.
however, I did then take your last advice literally...

pi@Sprinklers:~/SIP $ git checkout Py3_WIP
Branch Py3_WIP set up to track remote branch Py3_WIP from origin.

Now not working again. ...page not found and only ports 22 and 5900 open on scan...SSH working still...can iroll that back or do i need to tweak further?

Switched to a new branch 'Py3_WIP'

[dan]

git checkout master
will take you back to the original version (branch).

You can use
git branch
to check which branch you are on.

The plugins are the big problem right now. I am trying to get everything working by the end of the year.

Thanks for you feedback. It is a big help.

[draggaj]

thanks for YOUR assistance....obviously I am not a git-spurt......and I am taking your commands literally...no go for me. Same with sudo prefix.

pi@Sprinklers:~ $ git checkout master
fatal: Not a git repository (or any of the parent directories): .git
pi@Sprinklers:~ $ git
usage: git [--version] [--help] [-C <path>] [-c name=value]
[--exec-path[=<path>]] [--html-path] [--man-path] [--info-path]
[-p | --paginate | --no-pager] [--no-replace-objects] [--bare]
[--git-dir=<path>] [--work-tree=<path>] [--namespace=<name>]
<command> [<args>]

These are common Git commands used in various situations:

start a working area (see also: git help tutorial)
clone Clone a repository into a new directory
init Create an empty Git repository or reinitialize an existing one

work on the current change (see also: git help everyday)
add Add file contents to the index
mv Move or rename a file, a directory, or a symlink
reset Reset current HEAD to the specified state
rm Remove files from the working tree and from the index

examine the history and state (see also: git help revisions)
bisect Use binary search to find the commit that introduced a bug
grep Print lines matching a pattern
log Show commit logs
show Show various types of objects
status Show the working tree status

grow, mark and tweak your common history
branch List, create, or delete branches
checkout Switch branches or restore working tree files
commit Record changes to the repository
diff Show changes between commits, commit and working tree, etc
merge Join two or more development histories together
rebase Reapply commits on top of another base tip
tag Create, list, delete or verify a tag object signed with GPG

collaborate (see also: git help workflows)
fetch Download objects and refs from another repository
pull Fetch from and integrate with another repository or a local branch
push Update remote refs along with associated objects

'git help -a' and 'git help -g' list available subcommands and some
concept guides. See 'git help <command>' or 'git help <concept>'
to read about a specific subcommand or concept.
pi@Sprinklers:~ $ git version
git version 2.11.0

---

ignore that ....I needed to change to /home/pi/SIP/future directory for it to fly

pi@Sprinklers:~ $ git checkout master
fatal: Not a git repository (or any of the parent directories): .git
pi@Sprinklers:~ $ cd SIP
pi@Sprinklers:~/SIP $ ls
backports data gv.pyc i18n.py plugins ReverseProxied.py sip.pyc _thread webpages.pyc
blinker future gv_reference.txt i18n.pyc pylcd.py ReverseProxied.pyc sip.service urls.py
cheroot gpio_pins.py helpers.py __init__.py pylcd.pyc sessions six.py urls.pyc
convert_progs.py gpio_pins.pyc helpers.pyc ospi.pyc README.md sip3.service static web
convert_progs.pyc gv.py i18n past reprlib sip.py templates webpages.py
pi@Sprinklers:~/SIP $ cd future
pi@Sprinklers:~/SIP/future $ ls
backports builtins __init__.py __init__.pyc moves standard_library tests types utils
pi@Sprinklers:~/SIP/future $ git checkout master
Switched to branch 'master'
Your branch is up-to-date with 'origin/master'.
pi@Sprinklers:~/SIP/future $

then sudo reboot and its once again alive.....thanks, bob.

[gary]

Hi Dan,

Mixed success. I am still working with a new install to make sure I didn't introduce other problems.

Using the git checkout Py3_WIP did get MQTT plugin to work so I started to populate other information like Configure stations. Any update to this page causes the following error

pi@sprinkler:~/SIP $ sudo python3 sip.py
ERROR: MQTT Plugin requires paho mqtt.
try: pip install paho-mqtt
MQTT publish UP
Messge from Signaling plugin!: Just an example!
plugins loaded:
mobile_app
mqtt
mqtt_zones
plugin_manager
signaling_examples
system_update
Starting timing loop

zones changed
[0, 0, 0, 0, 0, 0, 0, 0]
http://:::80/
Traceback (most recent call last):
File "/home/pi/SIP/web/application.py", line 289, in process
return self.handle()
File "/home/pi/SIP/web/application.py", line 280, in handle
return self._delegate(fn, self.fvars, args)
File "/home/pi/SIP/web/application.py", line 530, in _delegate
return handle_class(cls)
File "/home/pi/SIP/web/application.py", line 508, in handle_class
return tocall(*args)
File "/home/pi/SIP/webpages.py", line 373, in GET
gv.sd[u"umo"][i] = int(qdict[u"m" + str(i)])
KeyError: 'umo'

I noticed the paho-mqtt error but checked and it is loaded.
pip3 install paho-mqtt
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Requirement already satisfied: paho-mqtt in /home/pi/.local/lib/python3.7/site-packages (1.5.0)

pi@sprinkler:~/SIP $ python3 -V
Python 3.7.3

pi@sprinkler:~/SIP $ git branch
* Py3_WIP
master

I tried a few other pages eg PROGRAMS, OPTIONS, PLUGINS and they seem to be working OK.

Went back to master to see what that looks like
And back to the LOADING problem again as the mqtt plugins are loaded.

I am not sure I understood what draggaj was saying about using the future dir?

So I am a bit stuck again and what to try next?

Thanks for your help
Gary

[dan]

@ Gary,
If you switch back to the master branch you will be using Python 2.
You will need to install paho with
pip instead of pip3

I appreciate your patience with these issues. It is a major change in the SIP code and I was hoeing to get everythin working before anyone started using the plugins. It involves testing each plugin one by one and there are still some problems.

[gary]

@ Gary,
If you switch back to the master branch you will be using Python 2.
You will need to install paho with
pip instead of pip3

I appreciate your patience with these issues. It is a major change in the SIP code and I was hoeing to get everythin working before anyone started using the plugins. It involves testing each plugin one by one and there are still some problems.

Hi Dan,

Yes I did have paho installed with python 2 just forgot to mention it. I am back on the Py3_WIP branch for the moment as it seems to almost be working for me.

That's Ok just thought I would let you know about the STATIONS page. It loads the page OK but as soon as you try and save anything it gives that error.

FYI I also removed the plugins and I was still getting the same error with the STATIONS page so perhaps this is not related to the plugins?

Let me know if you would like me to try anything.

pi@sprinkler:~/SIP $ sudo python3 sip.py
Messge from Signaling plugin!: Just an example!

plugins loaded:
  mobile_app
  plugin_manager
  signaling_examples
  system_update
zones changed
[0, 0, 0, 0, 0, 0, 0, 0]
Starting timing loop

http://192.168.0.162:80/
Traceback (most recent call last):
  File "/home/pi/SIP/web/application.py", line 289, in process
    return self.handle()
  File "/home/pi/SIP/web/application.py", line 280, in handle
    return self._delegate(fn, self.fvars, args)
  File "/home/pi/SIP/web/application.py", line 530, in _delegate
    return handle_class(cls)
  File "/home/pi/SIP/web/application.py", line 508, in handle_class
    return tocall(*args)
  File "/home/pi/SIP/webpages.py", line 373, in GET
    gv.sd[u"umo"][i] = int(qdict[u"m" + str(i)])
[color=#333333][size=small][font=Tahoma, Verdana, Arial, sans-serif]
KeyError: 'umo'

Thanks
Gary