函数计算与OSS集成
这段代码演示了如何将阿里云函数计算与OSS(对象存储服务)集成。它从指定的URL下载文件并将其上传到OSS存储桶。
代码
# -*- coding: utf-8 -*-
import oss2
import requests
import logging
import os
def handler(event, context):
# 配置
# model_url = "https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GGUF/resolve/main/mistral-7b-instruct-v0.2.Q4_K_M.gguf"
model_url = "https://storage.googleapis.com/lzwjava1/ss_urls.txt"
oss_bucket_name = "lzw-download" # 您的存储桶名称
oss_endpoint = "oss-cn-hangzhou.aliyuncs.com" # 公共endpoint
try:
# 使用提供的角色ARN创建身份验证对象
role_arn = "acs:ram::1768386076294612:role/fc"
auth = oss2.Auth(
os.environ['ALIBABA_CLOUD_ACCESS_KEY_ID'],
os.environ['ALIBABA_CLOUD_ACCESS_KEY_SECRET']
)
sts_auth = oss2.StsAuth(
os.environ['ALIBABA_CLOUD_ACCESS_KEY_ID'],
os.environ['ALIBABA_CLOUD_ACCESS_KEY_SECRET'],
os.environ['ALIBABA_CLOUD_SECURITY_TOKEN']
)
# 2. 使用正确的endpoint初始化OSS客户端
bucket = oss2.Bucket(
sts_auth,
oss_endpoint,
oss_bucket_name
)
# 3. 流下载和上传
logging.info("开始下载...")
with requests.get(model_url, stream=True) as response:
response.raise_for_status()
# 上传到OSS
result = bucket.put_object(
'models/mistral-7b-instruct-v0.2.Q4_K_M.gguf',
response.iter_content(chunk_size=1024*1024)
)
if result.status == 200:
logging.info("上传成功!")
return "Success"
else:
raise Exception(f"OSS上传失败: {result.status}")
except Exception as e:
logging.error(f"错误: {str(e)}")
raise e
错误
我们遇到了和之前一样的错误。看来需要VPN才能完成此任务。
2025-01-24 17:43:342025-01-24 17:43:34 1-679360a6-154b432a-15cadcce0c27 [ERROR] { “errorMessage”: “HTTPSConnectionPool(host=’huggingface.co’, port=443): Max retries exceeded with url: /TheBloke/Mistral-7B-Instruct-v0.2-GGUF/resolve/main/mistral-7b-instruct-v0.2.Q4_K_M.gguf (Caused by NewConnectionError(‘<urllib3.connection.HTTPSConnection object at 0x7f7d3c289f60>: Failed to establish a new connection: [Errno 101] Network is unreachable’))”