Geek asks and answers

How can I export data from the Google App Engine high replication data warehouse?

I am studying the use of the Google App Engine for a project and want me to have a way to export all my data if I ever decide to leave GAE (or GAE shuts down).

Everything I'm looking for about exporting data from GAE points to https://developers.google.com/appengine/docs/python/tools/uploadingdata . However, this page contains this note:

Note. This document is for applications using a master / slave data warehouse. If your application uses a high replication data warehouse, it is possible to copy data from the application, but Google currently supports this use case. If you try to copy from a high replication datastore, you will see a high_replication_warning error in the Admin Console, and the uploaded data may not include recently saved entities.

The problem is that recently the master / slave data warehouse has recently become deprecated in favor of the high replication data warehouse. I understand that the master / slave datastore is still supported for a while, but I don’t feel comfortable using something that is officially outdated and out of fashion. So this leaves me with a high replication data warehouse, and the only way to export the data is the method above, which is not officially supported (and therefore does not guarantee me that I can get my data).

Is there any other (officially supported) way to export data from a high replication data warehouse? I don’t feel comfortable using the Google App Engine if it means that my data may be permanently blocked.

+5
3

remote_api. , .

0

, GAE, , .

Unix, , script .

, "config_file", , , .

#!/bin/sh
#------------------------------------------------------------------
#-- Param 1 : Namespace
#-- Param 2 : Kind (table id)
#-- Param 3 : Directory in which the csv file should be stored
#-- Param 4 : output file name
#------------------------------------------------------------------
appcfg.py download_data --secure --email=$BACKUP_USERID --        config_file=configClientExtract.yml --filename=$3/$4.csv --kind=$2 --url=$BACKUP_WEBSITE/remote_api --namespace=$1 --passin <<-EOF $BACKUP_PASSWORD EOF
+2

The datastore application currently supports another option. Data backup can be used to copy selected data to blob storage or Google cloud storage. This feature is available in the data warehouse administration area of ​​the application console. If necessary, data backups can be downloaded from the blob viewer or cloud storage. To back up to a highly replicated data warehouse, it is recommended that the data warehouse records be disabled before the backup is accepted.

+1
source

More articles:


All Articles