python 2.7 - Scrapy Request callback method never called -

-

I am creating a crawlpidder using Scrapy 0.22.2 for Python 2.7.3 and I request that The callback method that I have never referred is called. Here is a snippet from my parsing method that initiates a request within an alief block: 

  elif current_status == "Superseded": # There is a lot of work to do here. It is to check whether the replacement unit is available or not. If not, download whatever is the outline # where we have a & lt; Td> The element in which "has been installed by" and update the link, which is updated_unit = hxs.xpath ('/ html / body / div [@ id = "page"] / div [@ id = "layoutWrapper"] / div [@ id = "twoColLayoutWrapper"] / div [@ id = "twoColLayoutLeft"] / div [@ class = "layoutContentWrapper"] / div [@ class = "external"] / div [@ class = "fieldset"] / div [@ Class = "display-row"] / div [@ class = "display-row"] / div [@ class = "display-field-info"] / div [@ class = "T-widget T-grid" ] / Table / tab / tr [1] / td [contains (".," Is overwritten by ")] / a '# update an update_link element of child = Update_enit.exp ('@ href'). Extract () [0] updated_url = "http: //training.gov.au" + updated_unit_link print "\ 033 [0; 31mSuperceded" + updated_url + "\ 033 [0m" #Red has been dispersed in print, the current yield request (url = updated_url, callback = 'sort upset', dont_filter = true) def sortSuperseded (auto, response): "I execute it and the URL is OK but sorted Has never been called because I have never printed in the 'console callback name' printed in the console  
 which URL I I am also looking for the domain that I specify for my crawlspider.  
  allowed_amman = ["training.gov.au"]   
 Where am I going wrong?   
 
 
 Quotation is not required around the callback method name. Change line:  
  from the yield request (url = updated_url, callback = 'sortedupeded', dont_filter = true)   
 to  
 < Code> yield request (updated_url, callback = self.sortSuperseded, dont_filter = True)

Comments

Post a Comment

Popular posts from this blog

Pass DB Connection parameters to a Kettle a.k.a PDI table Input step dynamically from Excel -

-
Image
I have a requirement whenever I run my own kettle, dynamically took database connection parameters from an excel source Every run should go. I have an Excel column names: hostname, username, database, password. I want to pass these connection parameters to my table input stage dynamically whenever it runs the job. This is what I was trying to do. You can get it Connection parameters from the DB reading source (for example Excel or a CSV file in my example) < / Li> Store the parameters in the variable Using the variable in your connection's settings. Setting Variables Create another conversion for (you can not do it in the same conversion Uses): set variables element variable: The element that reads / writes your data creates a new connection and sets the connection parameter using $ {variable name_} Note that you will need to type in the field field in the field $ {password} Also keep in mind that this can be a security problem as the
Read more

multithreading - PhantomJS-Node in a for Loop -

-
I am trying to implement a screen-scraps application that opens a URL in which a parameter changes as it is for a loop: var data = [ '100', '101', '102', '103', '104']; (Var indexA = 0; indexA & lt; data.length; indexA ++) for {Phantom Generation ({'port': freeport}, function (pH) {ph.create page (function (page) {page.open ("http: //...++ data [index B] +" ... " , Status {console.log ("open site:" + data [index B], position); / * OLD * / indexB ++; page evaluation (function () {// page scrape and an object Return}, function {console.log (result.dataRequest); // here is the problem}); / * new and fixed * / indexB ++} first console Logs it: Open Site: 100 Success Opens Site: 101 Success B Ola Site: 102 Success Opening Site: 103 Success Opened Site: 104 Success Which is good. Data is verified in scrap HTML and from index to array Matches. So in page 101 I scrap '101 and retrieve' and pu
Read more

c++ - MATLAB .m file to .mex file using Matlab Compiler -

-
I know that it can speak as a very famous topic, but something that helps me with it Not found This scenario is: I have my functions function, no matter what's inside, it's a generic function that may depend on other toolboxes. Does. Has input and output; I want to generate the same myFun.mex function; : Lib myFun This way I get some new files: libmyfun.c libmyfun.dll Libmyfun.exp libmyfun.exports libmyfun .h libmyfun.lib Reading around and I think that Creating a myfun.cpp that is very famous is included: / * gateway function * / zero max function (ent NLHS, MXARRA * PLS [], int NRHS, CONST M Xeray * PHS []) Here is the Variable Deals * / / * code here * /} I have tried to do this and are called Regular of Max Generation: Max ('- v', 'myfun.cpp') But I get many errors, and I should say that my myfun.cpp copy / Paste Function is where I have a lot of doubts ... especially on input / output management. My q
Read more