Python beautifulsoup not grabbing full table -

-

I'm not sure that it is not holding the full table due to mechanize

This works: Beautiful soup import page to import from imports = 'http://www.airchina.com.cn/www/jsp/airlines_operating_data/exlshow_en .jsp 'r = request.get (page) r.encoding =' utf-8 'soup = beautiful soup (rtext) div = soup.find (' div ', class_ =' main right '). Find_all ('div') [1] for cell in table row ('TD', recursive = falls) = div.find ('table', recursive = False) in the row. Find_all ('tr', recursive = falls): print cell.text.split ()

but it is not: 

  Import import import imports BS4 Import Beautiful Soup Import Request URL = 'http: //www.airchina.com.cn/www/jsp/airlines_operating_data/exlshow_en.jsp' control_year = ['2006', '2007', '2008', '200 9 '01', '02', '03', '04', '05', '06 ',' 0 ',' 0 ' 07 ',' 08 ', '09', '10', '11', '12'] Br = Entered. Broser () r = br.open (url) b r.select_form ("exl") control_m = br.form.find_control ('month') control_y = br.form.find_control ('year') br [control_m.name] = ['06'] br [control_y.name] = ['2012'] reaction = br.submit () soup = beautiful soup (feedback, 'html.parser') #div = soup.find ('div', class_ = 'Main right') div = soup.find ('find_all' ('div') [1] for line for div table = div.find ('table', recursive = folose). Tr ', recursive = falls): in line for cell (' TD ', recursive = falls): print cell.text.stip ()   
 that  mechanize  use The person only produces the bottom, even if in firebug I  tr  and  td   
  June 2012% vs Changes vs. June 2011 % Change versus May 2012 cumulative June 2012% cumulative change    
 
 
 Works without, so it may be related to  html.parser  you are using.   Import BS 4 from Import Import Beauti fulSoup URL = ('http://www.airchina.com.cn/www/jsp/airlines_operating_data/' 'exlshow_en.jsp') control_year = ['2006', '2007', '2008', '200', '2010', '2011', '2012', '2013', '2014'] Control_ms = ['01', '02', ' 03 ',' 04 ',' 05 ',' 06 ',' 07 '' 08 ', '09', '10', '11', '12'] br = Instrumentation. Brasar () r = br.open (url) br.select_form ("exl") control_m = br.form.find_control ('month') control_y = br.form.find_control ('year') br [control_m.name] = ['06'] br [control_y.name] = ['2012'] reaction = br.submit () soup = beautiful soup (reaction) div = soup.fund ('div', class_ = 'mainRight'). Find_all ('div') [1] table = div.find ('table', recursive = false) for line in table.find_all ('TR', recursive = Folce): cell in row ('TD', recursive = Falls): Print cell.text .Lit ()

Comments

Post a Comment

Popular posts from this blog

Pass DB Connection parameters to a Kettle a.k.a PDI table Input step dynamically from Excel -

-
Image
I have a requirement whenever I run my own kettle, dynamically took database connection parameters from an excel source Every run should go. I have an Excel column names: hostname, username, database, password. I want to pass these connection parameters to my table input stage dynamically whenever it runs the job. This is what I was trying to do. You can get it Connection parameters from the DB reading source (for example Excel or a CSV file in my example) < / Li> Store the parameters in the variable Using the variable in your connection's settings. Setting Variables Create another conversion for (you can not do it in the same conversion Uses): set variables element variable: The element that reads / writes your data creates a new connection and sets the connection parameter using $ {variable name_} Note that you will need to type in the field field in the field $ {password} Also keep in mind that this can be a security problem as the
Read more

multithreading - PhantomJS-Node in a for Loop -

-
I am trying to implement a screen-scraps application that opens a URL in which a parameter changes as it is for a loop: var data = [ '100', '101', '102', '103', '104']; (Var indexA = 0; indexA & lt; data.length; indexA ++) for {Phantom Generation ({'port': freeport}, function (pH) {ph.create page (function (page) {page.open ("http: //...++ data [index B] +" ... " , Status {console.log ("open site:" + data [index B], position); / * OLD * / indexB ++; page evaluation (function () {// page scrape and an object Return}, function {console.log (result.dataRequest); // here is the problem}); / * new and fixed * / indexB ++} first console Logs it: Open Site: 100 Success Opens Site: 101 Success B Ola Site: 102 Success Opening Site: 103 Success Opened Site: 104 Success Which is good. Data is verified in scrap HTML and from index to array Matches. So in page 101 I scrap '101 and retrieve' and pu
Read more

c++ - MATLAB .m file to .mex file using Matlab Compiler -

-
I know that it can speak as a very famous topic, but something that helps me with it Not found This scenario is: I have my functions function, no matter what's inside, it's a generic function that may depend on other toolboxes. Does. Has input and output; I want to generate the same myFun.mex function; : Lib myFun This way I get some new files: libmyfun.c libmyfun.dll Libmyfun.exp libmyfun.exports libmyfun .h libmyfun.lib Reading around and I think that Creating a myfun.cpp that is very famous is included: / * gateway function * / zero max function (ent NLHS, MXARRA * PLS [], int NRHS, CONST M Xeray * PHS []) Here is the Variable Deals * / / * code here * /} I have tried to do this and are called Regular of Max Generation: Max ('- v', 'myfun.cpp') But I get many errors, and I should say that my myfun.cpp copy / Paste Function is where I have a lot of doubts ... especially on input / output management. My q
Read more