python - Delete every non utf-8 symbols froms string -



python - Delete every non utf-8 symbols froms string -

i have big amount of files , parser. have strip non utf-8 symbols , set info in mongodb. have code this.

with open(fname, "r") fp: line in fp: line = line.strip() line = line.decode('utf-8', 'ignore') line = line.encode('utf-8', 'ignore')

somehow still error

bson.errors.invalidstringdata: strings in documents must valid utf-8: 1/b62010montecassianomcir\xe2\x86\x90ta0\xe2\x86\x90008923304320733/290066010401040101506055soccorin

i don't it. there simple way it?

upd: seems python , mongo don't agree definition of utf-8 valid string.

try below code line instead of lastly 2 lines. hope helps:

line=line.decode('utf-8','ignore').encode("utf-8")

python mongodb encode

Comments

Post a Comment

Popular posts from this blog

php - How to pass multiple values from url -

php - How to pass multiple values from url - i'm trying pass textbox , 1 select result value 1 page page.using url.but it's display error message. "parse error: syntax error, unexpected '' (t_encapsed_and_whitespace), expecting identifier (t_string) or variable (t_variable) or number (t_num_string) in c:.." while($value= mysqli_fetch_assoc($result)){ $apid=$value['apid']; echo("<tr> <td>". $value['apid'] ."</td> <td>".$value['email']."</td> <td>".$value['comments']."</td> <td>".'<input type="text" name="payment"/>'."</td> <td>"."<input type='text' name='apid' value='".$apid."' style='visibility:hidden' size='2'>"."</a>"."<a hre...
Read more

database - php search bar when I press submit with nothing in the search bar it shows all the data -

database - php search bar when I press submit with nothing in the search bar it shows all the data - the search fusion works correctly if press submit nil in search bar shows data. how message show saying nil has been entered search bar ?.i new php. <?php $mysql_host="host"; $mysql_database="database"; $mysql_user="username"; $mysql_password="password"; $dbconnect=@mysql_connect($mysql_host, $mysql_user, $mysql_password); // trys connect database if (!$dbconnect) { exit("an error has occurred - not connect database."); // if couldn't connect, allow user know } if(!mysql_select_db($mysql_database)) { exit("an error has occurred - not select database."); //if couldn't select db, allow user know } $output = ''; //collect if(isset($_post['search'])...
Read more

ios - How to load .png images from Documents folder of an app -

ios - How to load .png images from Documents folder of an app - i have .png images in documents folder of app when seek load them don't work :/ i have class methods saving , loading : uiimage+loadscan.h : #import <uikit/uikit.h> @interface uiimage (loadscan) - (void)savescan:(nsstring*)name; - (uiimage *)loadscan:(nsstring*)name; @end .m : #import "uiimage+loadscan.h" @implementation uiimage (loadscan) #pragma save , load - (void)savescan:(nsstring*)name{ if (self != nil) { nsarray *paths = nssearchpathfordirectoriesindomains(nsdocumentdirectory, nsuserdomainmask, yes); nsstring *documentsdirectory = [paths objectatindex:0]; nsstring* path = [documentsdirectory stringbyappendingpathcomponent: [nsstring stringwithstring:name] ]; nsdata* info = uiimagepngrepresentation(self); [data writetofile:path atomicall...
Read more