Python Latin Characters and Unicode -

-

I have a tree structure in which keywords can contain some Latin characters. I have a function that grows through all the leaves of trees and adds each keyword to a list under certain conditions.

Here I have the code to add these keywords to the list: 

  Print "Add:" + Self. Keyword leaf_list.append (self.keyword) print leaf_list   
 If the keyword is the keyword  università © , then my output is:  
 Adding: code: università © ['universit \ xc3 \ xa9']   
 It appears that the print function correctly shows Latin, but when I add it to the list, It gets decoded.  
 How can I change it? I need to be able to print the list with standard Latin characters, not their decoded versions.   
 
 
 You do not have Unicode objects, but byte string with UTF-8 encoded text. To print such byte strings on your terminal  may  work if your terminal is configured to handle UTF-8 text.  
 When a list is converted into a string, then the contents of the list  representation ; The result of  repr ()  function Represented string object, printable ASCII uses escape codes for any byte outside the range; For example, new lines are replaced by  \ n . Your UTF-8 bytes are presented by the  \ xhh  escape sequence.  
 If you were using Unicode objects, the representation of  \ xhh  will be escaped  still , but only Latin-1 class (outside ASCII ) For Unicode codepoints (the rest are displayed on the basis of  \ uhhhh  and  \ Uhhhhhhh  their codepoint); When reading, automatically encodes such values ​​in the right encoding for your terminal:  
  gt; & Gt; U'università © 'u'universit \ xe9' & gt; & Gt; & Gt; Lane (U'nagriti '©') 10> gt; & Gt; Print YuinGeeriti © 'University'   
 Compare it with a byte string:  
  & gt; & Gt; & Gt; 'University' '' University \ xc3 \ xa9 '' gt; & Gt; & Gt; Lane ('università ©') 11> gt; & Gt; 'University' © DCDAD ('UTF8') You'Ingerit \ xe 9 '& gt; & Gt; & Gt; Print 'università ©' università ©   
 Note that the length indicates that  ÃÆ'à ¢ â,¬Å¡Ãƒâ € šÃ, «It was my terminal that  Python with \ xc3 \ xa9  bytes presented in the Python session with the paste of the  Ã⠀ šÃ,  character, the way it is configured to use UTF-8 , And Python has detected it and decoded bytes when I have defined literally the  u '..'  Unicode object.  
 I firmly recommend that you can read the following articles to understand how Python handles Unicode, and what is the difference between Unicode text and encoded byte string:  < ul> 
  •  
     Joel Spolsky   
  •  
       
  •  
     by Ned Bottler   < / Ul>  

     




  
    •

    Comments

    Post a Comment

    Popular posts from this blog

    Pass DB Connection parameters to a Kettle a.k.a PDI table Input step dynamically from Excel -

    -
    Image
    I have a requirement whenever I run my own kettle, dynamically took database connection parameters from an excel source Every run should go. I have an Excel column names: hostname, username, database, password. I want to pass these connection parameters to my table input stage dynamically whenever it runs the job. This is what I was trying to do. You can get it Connection parameters from the DB reading source (for example Excel or a CSV file in my example) < / Li> Store the parameters in the variable Using the variable in your connection's settings. Setting Variables Create another conversion for (you can not do it in the same conversion Uses): set variables element variable: The element that reads / writes your data creates a new connection and sets the connection parameter using $ {variable name_} Note that you will need to type in the field field in the field $ {password} Also keep in mind that this can be a security problem as the
    Read more

    multithreading - PhantomJS-Node in a for Loop -

    -
    I am trying to implement a screen-scraps application that opens a URL in which a parameter changes as it is for a loop: var data = [ '100', '101', '102', '103', '104']; (Var indexA = 0; indexA & lt; data.length; indexA ++) for {Phantom Generation ({'port': freeport}, function (pH) {ph.create page (function (page) {page.open ("http: //...++ data [index B] +" ... " , Status {console.log ("open site:" + data [index B], position); / * OLD * / indexB ++; page evaluation (function () {// page scrape and an object Return}, function {console.log (result.dataRequest); // here is the problem}); / * new and fixed * / indexB ++} first console Logs it: Open Site: 100 Success Opens Site: 101 Success B Ola Site: 102 Success Opening Site: 103 Success Opened Site: 104 Success Which is good. Data is verified in scrap HTML and from index to array Matches. So in page 101 I scrap '101 and retrieve' and pu
    Read more

    c++ - MATLAB .m file to .mex file using Matlab Compiler -

    -
    I know that it can speak as a very famous topic, but something that helps me with it Not found This scenario is: I have my functions function, no matter what's inside, it's a generic function that may depend on other toolboxes. Does. Has input and output; I want to generate the same myFun.mex function; : Lib myFun This way I get some new files: libmyfun.c libmyfun.dll Libmyfun.exp libmyfun.exports libmyfun .h libmyfun.lib Reading around and I think that Creating a myfun.cpp that is very famous is included: / * gateway function * / zero max function (ent NLHS, MXARRA * PLS [], int NRHS, CONST M Xeray * PHS []) Here is the Variable Deals * / / * code here * /} I have tried to do this and are called Regular of Max Generation: Max ('- v', 'myfun.cpp') But I get many errors, and I should say that my myfun.cpp copy / Paste Function is where I have a lot of doubts ... especially on input / output management. My q
    Read more