Geek asks and answers

File access in s3n: // elasticmapreduce / samples / wordcount / input

How can I access the file located in the next S3 folder, which belongs to someone else

S3N: // elasticmapreduce / samples / WordCount / input

+5
source share
4 answers

The owner of the folder (most likely the file in the folder) should have made it available to an anonymous reader. If so, then s3n: // x / y ... translates to http://s3.amazonaws.com/x/y ... or http://x.s3.amazonaws.com/y ...

x is the name of the bucket. y ... is a path with a bucket.

, , . , , http://s3.amazonaws.com/x XML, "", S3, . : http://s3.amazonaws.com/elasticmapreduce

, , , , . AWS EBS s3://elasticmapreduce/samples/wordcount/input " ". s3 s3n, EMR, HTTP.

+3

s3n://elasticmapreduce/samples/wordcount/input Amazon Hadoop. -

  • Amazon Elastic MapReduce Job Flow (, ) Amazon Web Services , Keep Alive.
  • EC2 , EC2 Amazon Web Services
  • ssh EC2, hadoop, ssh -i keypair.pem hadoop@ec2-IPADDRESS.compute-1.amazonaws.com
  • , hadoop dfs -copyToLocal s3://elasticmapreduce/samples/wordcount/input/0002 .
  • sftp
+2

wordSplitter.py :

https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/wordSplitter.py

:

https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0012
https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0011
https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0010
https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0009
https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0008
https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0007
https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0006
https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0005
https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0004
https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0003
https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0002
https://elasticmapreduce.s3.amazonaws.com/samples/wordcount/input/0001
+2

Amazon S3 lacks the concept of folders, and the bucket is just a flat collection of objects. But you can list all the files that interest you in the browser with the following URL: s3.amazonaws.com/elasticmapreduce?prefix=samples/wordcount/input/

Then you can load them by specifying the full name, for example. s3.amazonaws.com/elasticmapreduce/samples/wordcount/input/0001

+2
source

More articles:


All Articles