Restore on Local Machine

Tried this a few week ago with help from @william and we got it to work

I have ERPNEXT hosted online at erpnext.com (all up to date with) and trying to make a local backup

So ernext online settings:
Installed Apps
ERPNext: v6.27.15
Frappe Framework: v6.27.16
Frappe Subscription: v0.0.1
Mandrill Integration: v0.0.1
Paypal Integration: v0.0.1

We worked out that wget does not work from ERPNExt.com so had to do a little bit of invention. I downloaded the backup file and uploaded to my own website

I downloaded the latest OVA and installed to Oracle VM - worked fine
Ran bench Update - all OK: so that should make the local copy and the cloud hosted copy all the same
I ran ERPNEXt on localhost:8080 and went through the setup procedure - all works OK

So now to restore
I followed these steps (that did work before)

goto frappe-bench folder
wget https://www.graphskill.co.uk/backup.sql.gz
Gunzip backup.sql.gz
bench --site erpnext.vm --force restore home/frappe/frappe-bench/backup.sql
It get asked for the MySql password so I enter “frappe”
Message says scheduler is enabled

so all looks OK

I go to localhost:8080 and get an Internal Server Error

I have tried this a few times and always end with the Internal server error. But it used to work a few weeks ago

Any ideas?

if you used to use an eronext.com hosting and migrated to a local host you need to remove Frappe Subscription and i think Mandrill Integration (not sure about this one) :

bench --site [sitename] uninstall-app Mandrill Integration
bench --site [sitename] uninstall-app Paypal Integration
bench --site [sitename] uninstall-app Frappe Subscription

and you have to reinstall these plugins after you finish you setup…

also after these use:
bench setup nginx
bench setup supervisor
sudo service nginx restart

and try to open again…

@ramielian

Thanks for the reply. Can I ask when I do this

So, should it be

  1. Download oracle and install
  2. Download OVA file and import to VM ( Should i run the ERPNExt setup now or not bother)
  3. Remove Mandrill, PayPal , Frappe from VM instance. (which folder should i be in to do that?)
  4. Download and install the backup file
  5. bench setup nginx, ,bench setup supervisor, sudo service nginx restart (which folder?)
  6. Now log in to ERPNExt and all should be well. If it is install Mandrill / paypal apps from within ERPNExt (what about the frappe subscription, how to I install that?

Tried lots of variations on this. But still I get the Internal Server Error

Any more ideas?

you are restoring the full image of the VM? why? do you have customized files in source code?

mostly what you need is a new installation of erpnext and a backup of the database, and restore the database on the new installation…

have a look at:

I was not aware I was restoring the whole image of the VM, I was under the impression that was the site name

So how can I find out [sitename]?

Your site name is erpnext.vm
What’s the procedure you are using to backup and restore ?

So if site name is erpnext.vm why did you think I was restoring the whole virtual machine?

The steps I am using is in post number 1

The backup comes from erpnext.com which i download and then upload to my own server (because wget does not want to work on erpnext.com)

Then I run oracle virtual machine and do:

goto frappe-bench folder
wget https://www.graphskill.co.uk/backup.sql.gz
Gunzip backup.sql.gz
bench --site erpnext.vm --force restore home/frappe/frappe-bench/backup.sql
It get asked for the MySql password so I enter “frappe”

That used to work. Now it gives Internal Server Error when i access localhost:8080

I had not noticed these additions:
bench --site [sitename] remove-from-installed-apps frappe_subscription
bench --site [sitename] migrate

But tried them now and there is no change

I have also tried various combinations of your earlier suggestions with uninstalling apps etc, and still get the same error

To be honest the lack of a proper backup / restore system fills me with dread as I try to evaluate this system to determine it’s suitability for our organisation

Backup and restore should be possible within the program, not require server side manipulations that most users will not have a clue about

Sorry I missed your posts because am answering many posts at one time using my mobile device not computer as I am on business travel and I am not a frappe developer / worker but I am a community user that’s it :slight_smile:

Do you want me to access to debug your server throw team viewer ? I would be happy to help any time on what I can do…

But in one thing u need to know the new installation of any Erpnext server using scripts not vm will use port 80 not 8080

And you can change it in the site_config file in the erpnext.vm folder…

Or use
bench set-nginx-port 80
Then
bench setup
bench restart

And open on port 80

@ramielian I appreciate your help but i give up.

I have spent hours, no days and days, trying to do what should be a simple restore. I will give up and watch carefully for V7, see if that has a proper backup and restore system

I think you are missing the main point in here: your restore have nothing to do with this error, its system configuration error not site restore Problem…

The site restore could be as simple as using import tool in Maria db to restore the database you have…
So the force restore is not your only option…

But your error is nginx related and you need a server admin to look at your configuration files for nginx…

May @vjFaLk (hi there :slight_smile: ) could help you more than me after this…

Hey @Ron_Taylor, the backup-restore system works alright.

This is what you should do from the get go. At this point I suggest spinning up a new VM with the image provided, and make sure it’s the latest one and then update it by running bench update. Don’t run the setup or anything.

Then follow the below steps
bench --site [sitename] --force restore /path/to/SQLFILE bench --site [sitename] remove-from-installed-apps frappe_subscription bench --site [sitename] migrate

This should do it.

Hi @vjFaLk

that is what I have been doing, over, and over and over again. Uninstalling VM (and even Oracle) every time. But still internal server error.

I will leave it for now. Not sure ERPNExt is going to be the solution for us.

I’m sorry you’re having troubles with restoring your data. If you decide to pick it back up again later just check if your VM is the latest and the braches for your ERPNExt and Frappe apps are in master.

The latest VM file is named : ERPNext-190416.ova

The way you check branches is by going into the frappe-bench/apps/frappe and frappe-bench/apps/erpnext folder and running the command git status

That will give you either “On branch develop” or “On branch master”. It should be “master”

Along with that, do you get an error when you do bench migrate?

OK back to this problem

I have upgraded to the hosted solution (5 user). I had hoped they could help but have pointed out to me that their support is only for the cloud, external backup / restore is not part of their remit. :confused:

What they did say is that I am getting error messages and advise I paste the error message here

But I have no idea how. I am using Oracle virtual machine so I can see a screen like this

can anyone explain how I can copy and paste from there to here because it does not seem to work

These are the steps I have taken:

See the post linked:

@Ben_Cornwell_Mott
thanks, tried that. No error messages now that I can see, but I still get the internal server error when accessing localhost:8080

I am getting lots of advice, but wonder if anyone else has actually installed Oracle VM on their windows computer and tried a restore? Has anyone actually managed to do this?

I have done exactly this. Ours is from a self-hosted version of erpnext and I use a VM to do development work. I often restore the database from our production server to my VM in order to use our latest data.

Have you tried bench restart? What message do you get when you try? Does everything stop and start properly? You should see:

frappe@erpnext:~/frappe-bench$ bench restart frappe-bench-frappe-schedule: stopped frappe-bench-frappe-default-worker-0: stopped frappe-bench-frappe-long-worker-0: stopped frappe-bench-frappe-short-worker-0: stopped frappe-bench-frappe-web: stopped frappe-bench-node-socketio: stopped frappe-bench-frappe-schedule: started frappe-bench-frappe-default-worker-0: started frappe-bench-frappe-long-worker-0: started frappe-bench-frappe-short-worker-0: started frappe-bench-node-socketio: started frappe-bench-frappe-web: started

Thanks for the confirmation Ben. So it should be possible, unless erpnext.com hosted somehow has different backup files

I have tried the restart, no effect. Same error. Incidentally how are you copy and pasting from VM? I cant copy the info from the VM to show messages etc. Can;t even scroll back up

Did you manage to look at the drop box document. Am I following the correct procedure?

Yes, using the VM means you can’t do any of those things. I end up using Putty to remote console in to my VM. Lets you copy and paste and scroll.

I just noticed the dropbox link.

Here are my recommendations:

  1. Start a new VM.
  2. Run bench update. Do not move to the next step until bench update successfully completes (no error messages)
  3. Follow your procedure for getting the back up and restoring using step 13 from your instructions. I’m not sure you need to specify the site. I also know that your VM needs to have all the correct apps installed before trying to restore. What I think this means is you might need to install erpnext subsrcription to your VM before running the restore.

I think one of the big issues you’re having is that you’re moving on to the next step when there are still errors from a previous step. When I went through the process, I tried the same thing and kept getting stumped. The only way I got it working was to make sure there were no issues before moving on.

Based on your dropbox post issue (step 9), resolving the bench update issue is easy:
Go to bench-repo folder git fetch git pull origin Go back to frappe-bench folder Run bench update

I hope this helps. If you run into any other errors, just post them and we can work through them. A successful bench update (run the second time after everything is updated) should look something like this (depending on the apps you have installed):

frappe@erpnext:~/frappe-bench$ bench update
INFO:bench.utils:updating bench
Already up-to-date.
Requirement already satisfied (use --upgrade to upgrade): Pillow in ./env/lib/python2.7/site-packages
INFO:bench.app:pulling frappe
From https://github.com/frappe/frappe

  • branch develop -> FETCH_HEAD
    Already up-to-date.
    INFO:bench.app:pulling erpnext
    From https://github.com/frappe/erpnext
  • branch develop -> FETCH_HEAD
    Already up-to-date.
    INFO:bench.app:pulling erpnext_demo
    From https://github.com/frappe/erpnext_demo
  • branch master -> FETCH_HEAD
    Already up-to-date.
    INFO:bench.app:pulling paypal_integration
    From https://github.com/frappe/paypal_integration
  • branch master -> FETCH_HEAD
    Already up-to-date.
    /home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indicat ion) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Pytho n to solve this. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#snimissingwarning.
    SNIMissingWarning
    /home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/vendor/requests/packages/urllib3/util/ssl.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents ur llib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.or g/en/latest/security.html#insecureplatformwarning.
    InsecurePlatformWarning
    Requirement already up-to-date: pip in ./env/lib/python2.7/site-packages
    Migrating erpnext.vm
    Updating frappe : [========================================]
    Updating erpnext : [========================================]
    Updating paypal_integration : [========================================]
    Updating velometro : [========================================]
    Wrote ./assets/js/print_format_v3.min.js - 18k
    Wrote ./assets/js/frappe-web.min.js - 108k
    Wrote ./assets/js/form.min.js - 130k
    Wrote ./assets/js/report.min.js - 158k
    Wrote ./assets/js/erpnext.min.js - 70k
    Wrote ./assets/css/list.min.css - 7k
    Wrote ./assets/js/item-dashboard.min.js - 6k
    Wrote ./assets/js/d3.min.js - 343k
    Wrote ./assets/css/report.min.css - 7k
    Wrote ./assets/css/frappe-web.css - 56k
    Wrote ./assets/js/list.min.js - 75k
    Wrote ./assets/js/dialog.min.js - 60k
    Wrote ./assets/js/desk.min.js - 237k
    Wrote ./assets/css/form.min.css - 2k
    Wrote ./assets/js/editor.min.js - 26k
    Wrote ./assets/css/erpnext.css - 3k
    Wrote ./assets/js/libs.min.js - 658k
    Wrote ./assets/js/erpnext-web.min.js - 1k
    Wrote ./assets/css/desk.min.css - 263k
    Wrote ./assets/css/module.min.css - 2k
    frappe-bench-frappe-schedule: stopped
    frappe-bench-frappe-default-worker-0: stopped
    frappe-bench-frappe-long-worker-0: stopped
    frappe-bench-frappe-short-worker-0: stopped
    frappe-bench-frappe-web: stopped
    frappe-bench-node-socketio: stopped
    frappe-bench-frappe-schedule: started
    frappe-bench-frappe-default-worker-0: started
    frappe-bench-frappe-long-worker-0: started
    frappe-bench-frappe-short-worker-0: started
    frappe-bench-node-socketio: started
    frappe-bench-frappe-web: started

Bench: Open source installer + admin for Frappe and ERPNext (https://erpnext.com)

frappe@erpnext:~/frappe-bench$