Has anyone tried running big data analytics on Big query using data generated in Google App Engine?
We have an application that generates a lot of transactions which are stored in data store. We need to be summarize and collate this data and the natural choice for this was Big Query. However getting data from Datastore to Big Table is proving very difficult. Specially if we want to run this analysis automatically every day etc.
Does anyone here have experience implementing such systems on google infrastructure?