Aws glacier unable to download archive

Its not like S3. To be able to download your files from Glacier, you have to restore them first. Stack Overflow for Teams — Collaborate and share knowledge with a private group. Create a free Team What is Teams? Collectives on Stack Overflow. Learn more. Asked 6 months ago. Active 6 months ago. Viewed times. My doubts, How do I see whether the datas are inside s3 or glacier. I saw after 2 days it was still in the s3 If the data is moved to glacier can we be able see them in the Glacier Management console in AWS?

How the Data download process will work? Was it same like downloading from s3 or not. Add a comment. Active Oldest Votes. How do I see whether the datas are inside s3 or glacier. I saw after 2 days it was still in the s3 They files in glacier are visible in S3. See point 1. Marcin Marcin k 9 9 gold badges silver badges bronze badges. Thanks for your reply Marcin. So what is the difference between mooving files from s3 to glacier via a policy rule and creating a vault from a glacier console.

In that case, is the download process is same like u mentioned above for both cases? MohamedAhkam The vault is the "old" way of using Glacier, separate from S3. Now glacier has been integrated with S3, before it was fully separate service. So if you want to use archives and values, then its fully independent from S3.

But i guess we can download data from a vault using the aws SDK for java. So in that case we don't need to restore the data right?

Likewise can't we directly download data from glacier without restoring? We are using "Expedited" mode for retrieval. Or you can create a SNS topic that will be triggered when the operation has finished. Note down the job id, you will need it for the next commands. If you want to check the status of the job, you can use the describe-job command.

It took 3hm in my case. You can get it faster, but you have to pay more for this. The command for downloading the inventory file is get-job-output. Actually, this command is used for downloading the output of any job.

You need the name of the vault, the job id and a file name. The output will be saved in the specified file, in our case inventory. And check below how an inventory file looks like. You will get in this file the description of the archive which was provided during upload.

This can help on identifying the archive. Note down the archive id. The file contains the type of the job archive-retrieval , the archive id and a description. It should look like below. There is one more thing to check: Data Retrieval Settings. The command for initiating the download archive request is the following:. And you have to wait. If you configured a SNS topic for the vault, you will get a notification when the job has finished.

At any time, you can interrogate the status of the job using the describe-job command. When the archive is ready for download, the describe-job output will look like below. Finally, you are ready to download the archive. If the archive is big like more than 4GB in my case it would be wiser to get it in chunks. You can see the size of the archive either in the inventory file or in the output of the describe-job command.

I split the file as following 1GB chunks :. To download the archive you have to use the same get-job-output command previously used for downloading the inventory file. You need the vault name, the job id, the range of bytes to retrieve from output and the file name where the content will be saved. The chunk size that I used was too big as the download command failed a couple of times, like this: [Errno ] An existing connection was forcibly closed by the remote host.

When you successfully downloaded all the pieces, all you have to do is to concatenate them:. And you are done!