Most python(3)esque way to repeatedly SELECT from MySQL database -

-

i have csv file of customer ids (crm_id). need primary keys (an autoincrement int) customers table of database. (i can't assured of integrity of crm_ids chose not make primary key).

so:

customers = [] open("crm_ids.csv", 'r', newline='') csvfile:     customerfile = csv.dictreader(csvfile, delimiter = ',', quotechar='"', skipinitialspace=true)     #only 1 "crm_id" field per row     customers = [c c in customerfile]

so far good? think pythonesque way of doing (but happy hear otherwise).

now comes ugly code. works, hate appending list because has copy , reallocate memory each loop, right? there better way (pre-allocate + enumerate keep track of index comes mind, maybe there's quickler/better way being clever sql not several thousand separate queries...)?

cnx = mysql.connector.connect(user='me', password=sys.argv[1], host="localhost", database="mydb") cursor = cnx.cursor() select_customer = ("select id customers crm_id = %(crm_id)s limit 1;") c_ids = [] row in customers:     cursor.execute(select_customer, row)     #note fetchone() returns tuple, selected set     #only has single column need column [0]     c_ids.extend(cursor.fetchall())     c_ids = [c[0] c in c_ids]

edit: purpose primary keys in list can use these allocate other data other csv files in linked tables (the customer id primary key foreign key these other tables, , allocation algorithm changes, it's best have flexibility allocation in python rather hard coding sql queries). know sounds little backwards, "client" works spreadsheets rather erp/plm, have build "relations" small app myself.

what changing query want?

crm_ids = ",".join(customers) select_customer = "select unique id customers crm_id in (%s);" % crm_ids

mysql should fine multi-megabyte query, according the manual; if gets really long list, can break - 2 or 3 queries guaranteed faster few thousand.


Comments

Post a Comment

Popular posts from this blog

java - Custom OutputStreamAppender not run: LOGBACK: No context given for <MYAPPENDER> -

-
i wish write custom appender on basis of outputstreamappender . wrote following class package tests; import java.io.ioexception; import java.io.outputstream; import ch.qos.logback.core.outputstreamappender; public class myappender<e> extends outputstreamappender<e> { public myappender() { system.out.println("myappender created"); setoutputstream(new outputstream() { @override public void write(int b) throws ioexception { throw new unsupportedoperationexception(); } }); } } then wrote following runner: package tests; import org.slf4j.loggerfactory; import ch.qos.logback.classic.logger; public class runner { private static final logger log = (logger) loggerfactory.getlogger(runner.class); public static void main(string[] args) { //log.addappender(new myappender<iloggingevent>()); log.info("hello world"); } } finall...
Read more

java - UML - How would you draw a try catch in a sequence diagram? -

-
Image
is there standard way of drawing try catch sequence diagrams? i've made attempt based on this feel end result doesn't feel right. code diagram based around: public static void save () { try { filehandle filehandle = gdx.files.external(file); filehandle.writestring(boolean.tostring(constantshandler.soundenabled)+"\n", false); (int = 0; < 5; i++) { filehandle.writestring(integer.tostring(constantshandler.highscores[i])+"\n", true); } } catch (throwable e) { } } my attempt note: know still need add loop. that's ok. fragments meant show conditional control flow in sequence diagram. superstructures puts limitations on use of fragments (see pp. 467 of ss2.1.1). should use critical region try part above. , option catch . however, keep telling can take quite freedom in using uml. it's language , such changes in life time. long reader ge...
Read more

c++ - No viable overloaded operator for references a map -

-
i trying use map can make tag names reference number. when try , use it, in code error (6 in total every time reference map): src/main.cpp:25:45: error: no viable overloaded operator[] type 'std::map<std::string, std::string>' const char* idcs = node.child_value(tagmap[3]); this code: #include "pugi/pugixml.hpp" #include <iostream> #include <string> #include <map> int main() { pugi::xml_document doca, docb; std::map<std::string, pugi::xml_node> mapa, mapb; std::map<std::string, std::string> tagmap {{"1", "data"}, {"2", "entry"}, {"3", "id"}, {"4", "content"}}; if (!doca.load_file("a.xml") || !docb.load_file("b.xml")) { std::cout << "can't find input files"; return 1; } (auto& node: doca.child(tagmap[1]).children(tagmap[2])) { co...
Read more