Acess to HMP community and functional profiling data

General microbial community science and analyses
1

Hello!

Apologies in advance if this is not the right place to ask these questions, but I’ve been really struggling to find a way to download abundances data from the HMP1 v2 project.

In the HMPDACC site, despite several attempts, I have been unable to complete the registration process. After submitting my details, I encounter a “Recaptcha not completed successfully” error message, or the page fails to reload entirely. I have tried using different browsers and have made multiple attempts, but unfortunately, I have not been able to access the data. I’ve encountered similar issues with the HMP feedback page.

With wget, I get a Forbidden 403 message, for example:

$ wget --no-check-certificate 'http://downloads.hmpdacc.org/data2/hhs/genome/microbiome/wgs/analysis/hmsmcp/v2/hmp1-II_metaphlan2-mtd-qcd.pcl.bz2'
--2025-03-14 10:03:15--  http://downloads.hmpdacc.org/data2/hhs/genome/microbiome/wgs/analysis/hmsmcp/v2/hmp1-II_metaphlan2-mtd-qcd.pcl.bz2
Resolving downloads.hmpdacc.org (downloads.hmpdacc.org)... 134.192.156.26
Connecting to downloads.hmpdacc.org (downloads.hmpdacc.org)|134.192.156.26|:80... connected.
HTTP request sent, awaiting response... 403 Forbidden
2025-03-14 10:03:16 ERROR 403: Forbidden.

The specific data I’m referring to are the abundances tables from HMP1 Version 2:

MetaPhlAn2 Community Profiling (HMSMCP2)

  • hmp1-II_metaphlan2-mtd-qcd.pcl.bz2

Functional Profiling (HMMRC2)

  • hmp1-II_humann2_pathabundance-nrm-mtd-qcd.pcl.bz2
  • hmp1-II_humann2_pathcoverage-mtd-qcd.pcl.bz2

Is it possible to obtain these datasets via an alternative method, or is there another way I could proceed to obtain the data.

Thank you so much, your assistance would be greatly appreciated!

2

The HMP website is no longer actively maintained, as the HMP/iHMP project concluded several years ago. All data has been successfully migrated to a public AWS cloud bucket, where the files are available for free download.
The data associated with HMSMCP2 can be accessed using the following commands provided you have AWS CLI installed:
$ aws s3 cp s3://hmpdcc/hmp1/hhs/microbiome/wms/analysis/community_prof/metaphlan2_2017/hmp1-II_metaphlan2-mtd-qcd.pcl.bz2 . --no-sign-request

Functional Profiling (HMMRC2)
$ aws s3 cp s3://hmpdcc/hmp1/hhs/microbiome/wms/analysis/metabolic_prof/humann2_2017/hmp1-II_humann2_pathabundance-nrm-mtd-qcd.pcl.bz2 . --no-sign-request
$ aws s3 cp s3://hmpdcc/hmp1/hhs/microbiome/wms/analysis/metabolic_prof/humann2_2017/hmp1-II_humann2_pathcoverage-mtd-qcd.pcl.bz2 . --no-sign-request

Please let me know if you have any other questions.
Suvvi