docker pull的断点续传

weixin_40465062 2024-07-08 08:07:06 阅读 80

docker pull的断点续传

1.修改/etc/docker/daemon.json2.重新启动docker3.docker resume 实况

1.修改/etc/docker/daemon.json

网络上有人说docker pull --continue可以断点续传,实测无效。dockers pull 根本没有–continue参数。

最终在github上找到了答案: 链接

按照其提示的办法进行,果然牛X。

<code>sudo gedit /etc/docker/daemon.json #添加features

{

"runtimes": {

"nvidia": {

"args": [],

"path": "nvidia-container-runtime"

}

},

"features": { "containerd-snapshotter": true}

}

关键就在添加一个features

{

"features": { "containerd-snapshotter": true}

}

2.重新启动docker

sudo systemctl restart docker

3.docker resume 实况

下面是我下载docker镜像的过程:

Unable to find image 'qwenllm/qwen:1.5-cu121' locally

1.5-cu121: Pulling from qwenllm/qwen

24ff69e0a1e4: Download complete

ea278ac08796: Download complete

96d54c3075c9: Download complete

35817692a87e: Download complete

e3f63d7242f5: Download complete

abb1d69f27ac: Download complete

7f2f3df7d40c: Downloading [==================================> ] 1.16GB/1.664GB

afa75cca3a04: Downloading [===========> ] 347.1MB/1.472GB

57789402a9b0: Download complete

8c35a1861813: Downloading [===============> ] 785.4MB/2.49GB

e0ca71d1a62f: Download complete

c994b81dcc65: Download complete

649b24b6bec3: Download complete

84b6a42e847a: Download complete

a7bc10701a5b: Download complete

34dbfe62ee6b: Download complete

76a627ca5e65: Download complete

4639b7cd68e5: Download complete

4f4fb700ef54: Download complete

e6b25515aa6b: Download complete

effb9636c5d5: Download complete

27cbf0d1b839: Download complete

48327c7f35fb: Download complete

755e535b54a3: Download complete

7d32a9230f8f: Download complete

^C

中间卡住,ctrl+c中断再来

Unable to find image 'qwenllm/qwen:1.5-cu121' locally

1.5-cu121: Pulling from qwenllm/qwen

8c35a1861813: Downloading [=============================> ] 1.489GB/2.49GB

34dbfe62ee6b: Already exists

4f4fb700ef54: Already exists

ea278ac08796: Already exists

effb9636c5d5: Already exists

abb1d69f27ac: Already exists

c994b81dcc65: Already exists

e3f63d7242f5: Already exists

48327c7f35fb: Already exists

27cbf0d1b839: Already exists

649b24b6bec3: Already exists

e6b25515aa6b: Already exists

57789402a9b0: Already exists

7f2f3df7d40c: Download complete

e0ca71d1a62f: Already exists

afa75cca3a04: Downloading [=================================================> ] 1.463GB/1.472GB

^C

又卡住,又ctrl+c中断再来

Unable to find image 'qwenllm/qwen:1.5-cu121' locally

1.5-cu121: Pulling from qwenllm/qwen

34dbfe62ee6b: Already exists

57789402a9b0: Already exists

e6b25515aa6b: Already exists

4f4fb700ef54: Already exists

27cbf0d1b839: Already exists

7f2f3df7d40c: Already exists

e3f63d7242f5: Already exists

649b24b6bec3: Already exists

ea278ac08796: Already exists

48327c7f35fb: Already exists

abb1d69f27ac: Already exists

8c35a1861813: Download complete

c994b81dcc65: Already exists

afa75cca3a04: Downloading [=================================================> ] 1.47GB/1.472GB

effb9636c5d5: Already exists

e0ca71d1a62f: Already exists

^C

再次卡住,再次ctrl+c中断继续

Unable to find image 'qwenllm/qwen:1.5-cu121' locally

1.5-cu121: Pulling from qwenllm/qwen

afa75cca3a04: Download complete

7f2f3df7d40c: Already exists

34dbfe62ee6b: Already exists

4f4fb700ef54: Already exists

27cbf0d1b839: Already exists

c994b81dcc65: Already exists

e0ca71d1a62f: Already exists

ea278ac08796: Already exists

57789402a9b0: Already exists

abb1d69f27ac: Already exists

e6b25515aa6b: Already exists

48327c7f35fb: Already exists

effb9636c5d5: Already exists

649b24b6bec3: Already exists

Digest: sha256:e73218ca1bf746310bca11f5456f7d1b09a0df0c58dceabcc27116cf93d96b91

Status: Downloaded newer image for qwenllm/qwen:1.5-cu121

==========

== CUDA ==

==========

CUDA Version 12.1.0

Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.

By pulling and using the container, you accept the terms and conditions of this license:

https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.

*************************

** DEPRECATION NOTICE! **

*************************

THIS IMAGE IS DEPRECATED and is scheduled for DELETION.

https://gitlab.com/nvidia/container-images/cuda/blob/master/doc/support-policy.md

root@xxxxxxxxx:/data/shared/Qwen# ls

cli_demo.py ds_config_zero2.json ds_config_zero3.json finetune.py finetune.sh web_demo.py

root@xxxxxxxxx:/data/shared/Qwen# nvcc --version

nvcc: NVIDIA (R) Cuda compiler driver

Copyright (c) 2005-2023 NVIDIA Corporation

Built on Mon_Apr__3_17:16:06_PDT_2023

Cuda compilation tools, release 12.1, V12.1.105

Build cuda_12.1.r12.1/compiler.32688072_0

root@xxxxxxxxx:/data/shared/Qwen# exit

exit

完美收工。



声明

本文内容仅代表作者观点,或转载于其他网站,本站不以此文作为商业用途
如有涉及侵权,请联系本站进行删除
转载本站原创文章,请注明来源及作者。