We have been launching BigQuery for about 4 months, and we have interesting observations and questions regarding prices:
- The pricing model is completely inexplicable; it needs explanations for associations, unions, etc.
- If I start a join on a small table, will my processed data increase for every copy of a small table that would be multiplied in the bigquery engine?
- If I reuse the same subquery inside the query, is this new data processing, regardless of what is the same subquery? Could this be optimized in any way? Does it cache a large amount of data?
- Is there a minimum size that is rounded for data processing? Our observations believe that it is 4 MB, is that right?
- The Google Console has a problem with geographic locations, it says that most requests are made from CA, which is wrong, since my company is located in Europe, and all this development is carried out there. I checked all IP addresses and there is no CA ip. Can I get a more detailed report?
- With regard to 5, we would like to receive a history of requests and prices for each of them. How can we do this? Should our software do this or?
- Relatively 3) I have this huge data processing problem (which is why I asked all the questions). My entire data set is about 150 mb, and yet the size of my DP for the request is 3 times larger? If bigquery reads all my data, it will not reach the sizes that it shows when processing the data. When are all the cases when the data will be re-read, and therefore a new DP will happen? And what do you think of this?
Thank.
Regards, Tomislav
source
share