python - Comparing two text files to remove duplication of the longer one -



python - Comparing two text files to remove duplication of the longer one -

i have 2 files 1 contains list of info delimited tab , sec 1 includes list of items' id 1 field. compare each first field in larger file (file1) lines/item id in smallest file(file2),then if compared id not exist in sec file want write info related compared item in first file(which line content separated tab). tried below code have problem loops. first loop doesn't increment while sec loops sec file lines. also, want item number written 1 time problem in if statement.

for lines in alldata: lines1 in olddata: old_data=lines1.split('\r\n') dataid=old_data[0] data=lines.split('\t') photoid=data[0] if photoid==dataid: break else: #continue #print('matching',lines) #break w=open(head+'......................../1.txt','a') w.write(lines)

this sample of files structure:

15463774518 2014-10-28 08:12:31 2014-10-28 13:12:31 15628560471 2014-10-26 07:40:28 2014-10-26 12:40:28 15444098878 2014-10-26 04:49:19 2014-10-26 09:49:19 15437269197 2014-10-25 09:55:11 2014-10-25 15:55:11

the little file looks like:

139747955 2417570005 2478707302 1808883457 211514265

i suggest next pseudo code. pythonic way of checking if id file 1 in id file 2 having list of ids file 2 , if id in idlist:.

let's have read ids of sec file list idlist_file2. read file one. parse line , check

with open(file1,'r') f: line in f: info = parse_line(line) # function according info format, either homecoming dict or tuple ever works best if date['id'] not in idlist_file2: do_something_with_this_info(data)

this should give starting point.

python file comparison

Comments

Post a Comment

Popular posts from this blog

xslt - DocBook 5 to PDF transform failing with error: "fo:flow" is missing child elements. Required content model: marker* -

xslt - DocBook 5 to PDF transform failing with error: "fo:flow" is missing child elements. Required content model: marker* - i've inherited doc publishing process takes docbook , builds html , pdf output, using apache fop both. project had been started, never completed. lots of tweaking, i've able of doc sets build (20+), except handful, , fail severe code 1 of these 2 conditions: "fo:flow" missing kid elements. required content model: marker* "fo:block" not valid kid of "fo:root" the xml output comes out of docbook , docbook-fop checks out well-formed. the fop error in 1 book, "endecagloss", example, points end of string: <fo:flow flow-name="xsl-region-body" start-indent="4pc" end-indent="0pt"/> here’s log output in case: [java] severe: javax.xml.transform.transformerexception: file:/scratch/publishing/hudson/jobs/build-main-endeca-documentation/workspace/serverdoc/w...
Read more

mediawiki - How do I insert tables inside infoboxes on Wikia pages? -

mediawiki - How do I insert tables inside infoboxes on Wikia pages? - i want insert tables in infoboxes. example, have proteinbox i've developed using infobox template (http://health-and-medicine.wikia.com/wiki/template:proteinbox), , fasta field big fit comfortably in proteinbox. hence collapsible table within box. this tried: {{infobox | row 1 = {| class = "mw-collapsible mw-collapsed wikitable" |- | <!-- table content --> |} }} your problem is, putting nested table within template. pipe characters ( | ) in table syntax collides pipe usage in templates. the commonly used hack around create template called template:! , containing pipe character, , utilize when need set tables, parser functions or other stuff using pipe characters, within templates. table (with every | replaced {{!}} ): {{{!}} {{!}}- {{!}} a1 {{!}} b1 {{!}}- {{!}} a2 {{!}} b2 {{!}}} ...the equivalent of {| |- | a1 | b1 |- | a2 | b2 |} furthermore, hav...
Read more

Local Service User Logged into Windows -

Local Service User Logged into Windows - i created windows service tracks app server user connected through load balancer. it retrieves user logged windows on machine, cross references active directory (ad) business relationship homecoming first name, lastly name , e-mail (for notification through website created project) there 1 scheme on network users remote system, vista system, reason returning values "local service" logged machine, it's weird , security guys impossible "local service" business relationship logged windows. here how user logged windows managementscope ms = new managementscope("\\\\.\\root\\cimv2"); objectquery query = new objectquery("select * win32_computersystem"); managementobjectsearcher searcher = new managementobjectsearcher(ms, query); foreach (managementobject mo in searcher.get()) { _username = mo["username"].tostring(); } // remove domain part username string[] usernameparts = _...
Read more