Comments on: The wisdom of DEBUG=False when loading LOTS of data. http://www.rhonabwy.com/wp/2006/11/14/the-wisdom-of-debugfalse-when-loading-lots-of-data/ Mac, iOS, DevOps, and daily life in Seattle Fri, 25 Nov 2011 06:40:42 +0000 hourly 1 http://wordpress.org/?v=3.3 By: Dave Jones http://www.rhonabwy.com/wp/2006/11/14/the-wisdom-of-debugfalse-when-loading-lots-of-data/comment-page-1/#comment-65346 Dave Jones Sat, 21 Jun 2008 12:12:28 +0000 http://www.rhonabwy.com/wp/2006/11/14/the-wisdom-of-debugfalse-when-loading-lots-of-data/#comment-65346 Thank you so much, this is exactly the problem I had. Django ORM worked fine for importing the smaller (legacy) tables into my application, but ran out of memory on importing the 225K rows of data in my history table. Thanks again for the solution. Thank you so much, this is exactly the problem I had. Django ORM worked fine for importing the smaller (legacy) tables into my application, but ran out of memory on importing the 225K rows of data in my history table.

Thanks again for the solution.

]]> By: David Grant http://www.rhonabwy.com/wp/2006/11/14/the-wisdom-of-debugfalse-when-loading-lots-of-data/comment-page-1/#comment-2424 David Grant Tue, 21 Nov 2006 06:21:54 +0000 http://www.rhonabwy.com/wp/2006/11/14/the-wisdom-of-debugfalse-when-loading-lots-of-data/#comment-2424 Oh I got confused, I saw the cursor stuff and immediately thought that you were doing sql to load the data. Stupid me...you were just using sql to get the list of tables and drop them. Oh I got confused, I saw the cursor stuff and immediately thought that you were doing sql to load the data. Stupid me…you were just using sql to get the list of tables and drop them.

]]> By: Joe http://www.rhonabwy.com/wp/2006/11/14/the-wisdom-of-debugfalse-when-loading-lots-of-data/comment-page-1/#comment-2400 Joe Mon, 20 Nov 2006 06:41:02 +0000 http://www.rhonabwy.com/wp/2006/11/14/the-wisdom-of-debugfalse-when-loading-lots-of-data/#comment-2400 We could have used straight SQL, but we were using the Django ORM setup because it was easier. The only thing we hadn't counted on was how many SQL statements would get made when we were "bulk loading" using it with DEBUG=True, the cursor object keeping a copy of all those statements in memory... We could have used straight SQL, but we were using the Django ORM setup because it was easier. The only thing we hadn’t counted on was how many SQL statements would get made when we were “bulk loading” using it with DEBUG=True, the cursor object keeping a copy of all those statements in memory…

]]> By: David Grant http://www.rhonabwy.com/wp/2006/11/14/the-wisdom-of-debugfalse-when-loading-lots-of-data/comment-page-1/#comment-2398 David Grant Mon, 20 Nov 2006 06:30:08 +0000 http://www.rhonabwy.com/wp/2006/11/14/the-wisdom-of-debugfalse-when-loading-lots-of-data/#comment-2398 Do you need to do SQL to load initial data? Can't you use the Django ORM? Do you need to do SQL to load initial data? Can’t you use the Django ORM?

]]>