Exporting data to AWS S3 bucket...

 
1
0
-1

I need a repository of adoptable dogs for a neural network I am training. I need to be able to agreegate all the images and associated information to one location (url, dog name, image). 

With the RG API how can I extract this information efficiently?

    CommentAdd your comment...

    2 answers

    1.  
      1
      0
      -1

      Abhi,

      There may be a few ways to accomplish what you want. I may not understand your requirements completely, so feel free to clarify if I misunderstood!

      My first thought was to use the nightly JSON export which is available via FTP download.  You can read more about it here:

      Complete Adoptable Pet Data Download via FTP

      The data set includes multiple pet data files, with up to 1,000 pets per pets_X.json.zip.  Each JSON file contains multiple JSON objects (one for each pet).

      If you were to download and process the pet files you could save the JSON data for each pet into a path on S3. That pet data provides all of the public information about the pet, including the picture URLs, so at the same time you could grab the image files and save into that same path.

      Hope that helps,

      Richard

        CommentAdd your comment...
      1.  
        1
        0
        -1

        Richard [RG]... Thank you for the prompt response! I've enabled FTP access for my API key and looks like by 6AM EST tomorrow I will have access to those JSONs. Thanks for the intel. I appreciate it. 

          CommentAdd your comment...