函数计算与OSS集成

Home PDF

这段代码演示了如何将阿里云函数计算与OSS(对象存储服务)集成。它从指定的URL下载文件并将其上传到OSS存储桶。

代码

# -*- coding: utf-8 -*-
import oss2
import requests
import logging
import os

def handler(event, context):
    # 配置
    # model_url = "https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GGUF/resolve/main/mistral-7b-instruct-v0.2.Q4_K_M.gguf"

    model_url = "https://storage.googleapis.com/lzwjava1/ss_urls.txt"
    oss_bucket_name = "lzw-download"  # 您的存储桶名称
    oss_endpoint = "oss-cn-hangzhou.aliyuncs.com"  # 公共endpoint

    try:
        # 使用提供的角色ARN创建身份验证对象
        role_arn = "acs:ram::1768386076294612:role/fc"
        auth = oss2.Auth(
            os.environ['ALIBABA_CLOUD_ACCESS_KEY_ID'],
            os.environ['ALIBABA_CLOUD_ACCESS_KEY_SECRET']
        )

        sts_auth = oss2.StsAuth(
            os.environ['ALIBABA_CLOUD_ACCESS_KEY_ID'],
            os.environ['ALIBABA_CLOUD_ACCESS_KEY_SECRET'],
            os.environ['ALIBABA_CLOUD_SECURITY_TOKEN']
        )

        # 2. 使用正确的endpoint初始化OSS客户端
        bucket = oss2.Bucket(
            sts_auth,
            oss_endpoint,
            oss_bucket_name
        )

        # 3. 流下载和上传
        logging.info("开始下载...")
        with requests.get(model_url, stream=True) as response:
            response.raise_for_status()

            # 上传到OSS
            result = bucket.put_object(
                'models/mistral-7b-instruct-v0.2.Q4_K_M.gguf',
                response.iter_content(chunk_size=1024*1024)
            )

        if result.status == 200:
            logging.info("上传成功!")
            return "Success"
        else:
            raise Exception(f"OSS上传失败: {result.status}")

    except Exception as e:
        logging.error(f"错误: {str(e)}")
        raise e

错误

我们遇到了和之前一样的错误。看来需要VPN才能完成此任务。

2025-01-24 17:43:342025-01-24 17:43:34 1-679360a6-154b432a-15cadcce0c27 [ERROR] { “errorMessage”: “HTTPSConnectionPool(host=’huggingface.co’, port=443): Max retries exceeded with url: /TheBloke/Mistral-7B-Instruct-v0.2-GGUF/resolve/main/mistral-7b-instruct-v0.2.Q4_K_M.gguf (Caused by NewConnectionError(‘<urllib3.connection.HTTPSConnection object at 0x7f7d3c289f60>: Failed to establish a new connection: [Errno 101] Network is unreachable’))”


Back 2025.02.22 Donate