目录

安装numpy

安装 nltk

安装Torch 

 安装transformers

安装 numpy

安装numpy的话参考下边的链接即可(亲测有效)：

Linux下安装numpy_abc_321a的博客-CSDN博客_linux安装numpy

或者用pip 安装

pip install numpy

常见问题：

(1)  numpy版本不正确，所以报错。

Traceback (most recent call last):
  File "run_disamb.py", line 471, in <module>
    main()
  File "run_disamb.py", line 414, in main
    global_step, tr_loss = train(args, train_dataset, model, tokenizer)
  File "run_disamb.py", line 205, in train
    results = evaluate(args, model, tokenizer)
  File "run_disamb.py", line 280, in evaluate
    all_pred_indexes = torch.cat(all_pred_indexes).numpy()
RuntimeError: Numpy is not available

 解决方案： 先用pip卸载numpy，然后再装版本稍微高一点的numpy。比如我的是先从1.19.0 版本升到 1. 20.0版本 ，结果还是不行， 后来升到 1.22.3 版本就可以了。

$ pip uninstall numpy

$ pip install numpy==1.22.3 -i https://pypi.douban.com/simple/

 (2)  由于下载源是国外的，一直报错超时。

(pytorch_1.10) [acctrm9ew5@login04 ~]$ pip install numpy==1.20
Collecting numpy==1.20
  Downloading numpy-1.20.0-cp38-cp38-manylinux2010_x86_64.whl (15.4 MB)
     ━━━━━━━━━━━━━━━━╺━━━━━━━━━━━━━━━━━━━━━━━ 6.3/15.4 MB 11.5 kB/s eta 0:13:04
ERROR: Exception:
Traceback (most recent call last):
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 435, in _error_catcher
    yield
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 516, in read
    data = self._fp.read(amt) if not fp_closed else b""
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 90, in read
    data = self.__fp.read(amt)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/http/client.py", line 459, in read
    n = self.readinto(b)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/http/client.py", line 503, in readinto
    n = self.fp.readinto(b)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/cli/base_command.py", line 167, in exc_logging_wrapper
    status = run_func(*args)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/cli/req_command.py", line 247, in wrapper
    return func(self, options, args)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/commands/install.py", line 369, in run
    requirement_set = resolver.resolve(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 92, in resolve
    result = self._result = resolver.resolve(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/resolvers.py", line 481, in resolve
    state = resolution.resolve(requirements, max_rounds=max_rounds)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/resolvers.py", line 348, in resolve
    self._add_to_criteria(self.state.criteria, r, parent=None)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/resolvers.py", line 172, in _add_to_criteria
    if not criterion.candidates:
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/resolvelib/structs.py", line 151, in __bool__
    return bool(self._sequence)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 155, in __bool__
    return any(self)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 143, in <genexpr>
    return (c for c in iterator if id(c) not in self._incompatible_ids)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 47, in _iter_built
    candidate = func()
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 206, in _make_candidate_from_link
    self._link_candidate_cache[link] = LinkCandidate(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 297, in __init__
    super().__init__(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 162, in __init__
    self.dist = self._prepare()
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 231, in _prepare
    dist = self._prepare_distribution()
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 308, in _prepare_distribution
    return preparer.prepare_linked_requirement(self._ireq, parallel_builds=True)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 438, in prepare_linked_requirement
    return self._prepare_linked_requirement(req, parallel_builds)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 483, in _prepare_linked_requirement
    local_file = unpack_url(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 165, in unpack_url
    file = get_http_url(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 106, in get_http_url
    from_path, content_type = download(link, temp_dir.path)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/network/download.py", line 147, in __call__
    for chunk in chunks:
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/cli/progress_bars.py", line 53, in _rich_progress_bar
    for chunk in iterable:
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_internal/network/utils.py", line 63, in response_chunks
    for chunk in response.raw.stream(
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 573, in stream
    data = self.read(amt=amt, decode_content=decode_content)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 538, in read
    raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "/work/home/acctrm9ew5/miniconda3/envs/pytorch_1.10/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 440, in _error_catcher
    raise ReadTimeoutError(self._pool, None, "Read timed out.")
pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out.

 解决方法：换一个源下载numpy。(我这里是在曙光平台上下载的，如果有小伙伴从这个源下载失败的话，可以再找个合适的源试试)

$ pip install numpy==1.20 -i https://pypi.douban.com/simple/

 

安装 nltk

pip install nltk

安装 torch 

从下边链接中选个合适的版本 

Previous PyTorch Versions | PyTorch

也可以从此链接中下载：

https://download.pytorch.org/whl/torch_stable.html

注：我的cuda 是 10.1 ，选的torch 版本是1.5.0，所以命令行是：

pip install torch==1.5.0+cu101 torchvision==0.6.0+cu101 -f https://download.pytorch.org/whl/torch_stable.html

​

 安装 transformers

pip install  transformers

# python # 深度学习 # 机器学习 # linux
GitHub 加速计划 / tra / transformers
130.24 K
25.88 K
下载
huggingface/transformers: 是一个基于 Python 的自然语言处理库，它使用了 PostgreSQL 数据库存储数据。适合用于自然语言处理任务的开发和实现，特别是对于需要使用 Python 和 PostgreSQL 数据库的场景。特点是自然语言处理库、Python、PostgreSQL 数据库。
最近提交(Master分支：3 个月前 )
54aae121 * handle single timestamp ending * include last timestamp token * handle single timestamp ending * avoid floating points arithm limitations * ensure float64 operations * new test * make fixup * make copies * handle edge case double tokens ending with different tokens * handle single timestamp ending * make fixup * handle conditioning on prev segments * fix * Update src/transformers/models/whisper/generation_whisper.py Co-authored-by: Yoach Lacombe <52246514+ylacombe@users.noreply.github.com> * [run-slow] whisper * don't call item() to avoid unnecessary sync * fix --------- Co-authored-by: Yoach Lacombe <52246514+ylacombe@users.noreply.github.com> Co-authored-by: Eustache Le Bihan <eustlb@users.noreply.huggingface.co> 13 小时前
beb2c66e * fix * fix * fix * fix --------- Co-authored-by: ydshieh <ydshieh@users.noreply.github.com> 17 小时前
Logo
GitCode 开源社区

旨在为数千万中国开发者提供一个无缝且高效的云端环境，以支持学习、使用和贡献开源项目。

更多推荐

[转载]在Windows环境下安装GNU Radio

转自：在Windows环境下安装GNURadio_恐弱智_新浪博客GNU Radio是用Python开发的，大部分开源的工程能够在Linux环境下运行良好，而Windows下却运行的很勉强，而且安装配置都很复杂。GNU Radio算是个例外了，不光提供了Windows的二进制安装，还有比较详细的说明。我是Python小白，所以折腾了好久才弄好，特意记录下来，免得以后再装还折腾。GNU Radio的

avatar GitCode 开源社区

centOS 8 使用dnf安装Docker

DNF是什么？CentOS 8使用YUM软件包管理器版本v4.0.4。现在，该版本使用DNF(已删除YUM)。DNF是软件包管理器。它会在Linux发行版上安装，执行更新并删除软件包。使用DNF安装Docker跳过具有损坏依赖性的程序包一个有效的解决方案是使您的CentOS 8系统使用以下--nobest命令安装最符合条件的版本：sudo dnf install docker...

avatar GitCode 开源社区

定时同步数据库表(mysql+linux+crontab)

sync.sh里面的参数需要改变，ip/username/password/database/tablesync.sh#!/bin/sh# Please change the IP and password of the data source db.# Then change the table name.filename=/home/nington/db/$(date +%Y-%m

avatar GitCode 开源社区