python - mrjob: Invalid bootstrap action path, must be a location in Amazon S3 -

-

I am on Windows 7. I have installed mrjob and when I run from the website, it works fine on the local machine. However, I get an error when trying to run it on the Amazon EMR. . EMR: Aws_access_key_id: Xxxxxxxxxxxxx Aws_region: us former -1 aws_secret_access_key I just Boto and it works with the Amazon S3

mrjob.conf file 

  runners tested adding: XXXXXXXX ec2_key_pair: bzy ec2_key_pair_file: C: \ aa.pem ec2_instance_type: m1.small num_ec2_instances: 3 s3_log_uri: S3: // myunique / s3_scratch_uri: S3: // myunique /   < P> Run in my CMD  
  dragon word_count.py -c mrjob.conf -r emr mytext.txt   
 it creates  
 Enter image details here  
 On suggestions that this is a window There was a problem related, I double checked the source code in parse.py, and it seems that there should be relevant probing to deal with window file types  
  # candidate candidate Uri is actually a local Whether or not the window is in the way, it is used to check. WINPATH_RE = re.compile (r "^ [aA-zZ]: \\") def is_windows_path (uri): "" "return true if * Yuri is a window path." "" If WINPATH_RE.match (uri): returns true: return incorrect is_uri (uri): "" "If true, return URI to any type of URI." "If_windows_path (uri): Return false return bool (urlparse (uri) .checkme)   
 I am getting the error after that I update code which is not understood , And I'm not sure how to proceed with it.   
 
 
 The problems you are facing Are in the way of the escape file (backslash) due to the Windows file system, just repeat it and you should not have any other problem.  
 Your Change the mrjob.conf file to:  
  runner: AMR: aves_acce_key_id: xxxxxxxxxxxxx aws_region: us-east -1 aws_secret_access_key: XXXXXXXX ec2_key_pair: bzy ec2_key_pair_file: C: \\ aa.pem ec2_instance_type : m1.small num_ec2_instances: 3 s3_log_uri: S3: // myunique / s3_scratch_uri: S3: // myunique /   
 Go here for more information:   < / Html>

Comments

Post a Comment

Popular posts from this blog

python - Writing Greek in matplotlib labels, titles -

-
Image
I'm trying to write some text for labels, shape titles etc. with my plots, but no benefit till now Has not happened . I do not want to print specific characters (I know how to use special characters), I want to write the entire text in Greek (maybe Unicode and text ' ?). , suggesting that I would like to mention that for some reason I can not get matplotlib to cooperate with Tex (using IPython notebook from Anaconda in Ubuntu 14.10) so that there really is an option Will not be the first. I tried loading the Arial font and it loads successfully but again I get square blocks instead of characters. I import matplotlib.font_manager FM PROP = FM Font Properties (fname = '/ usr / share / fonts / truetype / msttcorefonts / Arial.ttf') And then to display the string I u'Î? ? I ?? Î¿Ï ?? ÎμÎ »second ?? μΠ± i ?? I ± i ?? I ?? Used ο किया? ? Î¿Î¼Î¿Î¯Ï ?? I ?? I · I ?? ' . Ariel is considered to be fully presented to Greek and I have used it many times ...
Read more

c# - LINQ to Entities does not recognize the method 'Int32 IndexOf(System.String, System.StringComparison)' method -

-
I have performed a linq query using Entityframework as below GroupMaster getGroup = Null; GetGroup = DataContext.Groups.FirstOrDefault (item = & gt; keyword.IndexOf (item.Keywords, StringComparison.OrdinalIgnoreCase)> = 0 & amp; amp; item.ISNAmd) I found an exception like the method when executing it LINQ units do not recognize the 'Inter 32 index of (system string, system. String compromise)' method, and This method can not be translated to Store expression. Includes () method is sensitive by default, then I need to convert to minimize. Is there any method in which a string match match is examined and whether there is any method to solve the index question of the method? You actually have four options Databases globally Change the colon of it can be done in many ways, a simple Google search should reveal to them. Change the mix of individual tables or columns. Use a stored procedure and specify the call statement on your query Perform...
Read more

Pygame memory leak with transform.flip -

-
Today I came across an interesting issue which, by writing a small side scroller, instead of a sprite sheet, I was planning to use because I lacked a good "packer" for making phantom sheets (and honestly with patience and passion as it is only a test project). Anyway, I showed the animation running on the right of 8 PNG (with transparency). I considered it a good idea to prepare the flipped images to run on the left in the consultant, and the frame is not framed when the game is running (Flip actually consumes a lot of CPU like I Was measured). > To get access to the loop, I get the memory leak self.move_l = [# 8 PNG images with transparency to the right] For the self in IMG. Move_l: self.move_r.append (pygame.transform.flip (img, true, false) error traceback: traceback (most recent Call final): The file "D: \ Python 34 \ _Projects \ efg \ efg.py", in line 196, in the & lt; module & gt; main = master program ((1024, 680)) "D: \ Python ...
Read more