DataHub 0.8.14.1安装方法

好像跟之前我写的那个在安装上有区别

修改pip 源
建议用阿里云的源,豆瓣源有问题

python3 -m pip config set global.index-url  https://mirrors.aliyun.com/pypi/simple/
Writing to /root/.config/pip/pip.conf

或者

python3 -m pip install -i http://pypi.douban.com/simple --trusted-host pypi.douban.com

参考官方文档

python3 -m pip install --upgrade pip wheel setuptools
python3 -m pip uninstall datahub acryl-datahub || true  # sanity check - ok if it fails
python3 -m pip install --upgrade acryl-datahubdatahub version

插件检测及安装

 python3 -m datahub check plugins
Sources:
athena         (disabled)
azure-ad
bigquery       (disabled)
bigquery-usage (disabled)
datahub-business-glossary
dbt
druid          (disabled)
feast
file
glue           (disabled)
hive           (disabled)
kafka          (disabled)
kafka-connect  (disabled)
ldap           (disabled)
looker         (disabled)
lookml         (disabled)
mongodb        (disabled)
mssql          (disabled)
mysql          (disabled)
okta           (disabled)
oracle         (disabled)
postgres       (disabled)
redash         (disabled)
redshift       (disabled)
sagemaker      (disabled)
snowflake      (disabled)
snowflake-usage(disabled)
sqlalchemy     (disabled)
superset

Sinks:
console
datahub-kafka  (disabled)
datahub-rest
file

Transformers:
add_dataset_ownership
add_dataset_tags
mark_dataset_status
pattern_add_dataset_ownership
set_dataset_browse_path
simple_add_dataset_ownership
simple_add_dataset_tags
simple_remove_dataset_ownership

For details on why a plugin is disabled, rerun with '--verbose'
If a plugin is disabled, try running: pip install 'acryl-datahub[<plugin>]'

根据官方文档安装mysql及postgresql插件

python3 -m pip install 'acryl-datahub[postgres]'
python3 -m pip install 'acryl-datahub[mysql]'

postgresql
python3 -m pip install 'acryl-datahub[postgres]'
Requirement already satisfied: acryl-datahub[postgres] in /usr/local/python3/lib/python3.8/site-packages (0.8.14.1)
Requirement already satisfied: typing-inspect in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.7.1)
Requirement already satisfied: entrypoints in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.3)
Requirement already satisfied: toml>=0.10.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.10.2)
Requirement already satisfied: tabulate in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.8.9)
Requirement already satisfied: mypy-extensions>=0.4.3 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.4.3)
Requirement already satisfied: expandvars>=0.6.5 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.7.0)
Requirement already satisfied: python-dateutil>=2.8.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (2.8.2)
Requirement already satisfied: avro-python3>=1.8.2 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (1.10.1)
Requirement already satisfied: pydantic>=1.5.1 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (1.8.2)
Requirement already satisfied: click>=6.0.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (8.0.1)
Requirement already satisfied: click-default-group in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (1.2.2)
Requirement already satisfied: stackprinter in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.2.5)
Requirement already satisfied: docker in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (4.4.1)
Requirement already satisfied: PyYAML in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (5.3.1)
Requirement already satisfied: avro-gen3==0.6.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.6.0)
Collecting sqlalchemy==1.3.24
  Downloading SQLAlchemy-1.3.24-cp38-cp38-manylinux2010_x86_64.whl (1.3 MB)
     |████████████████████████████████| 1.3 MB 194 kB/s 
Collecting GeoAlchemy2
  Downloading GeoAlchemy2-0.9.4-py2.py3-none-any.whl (32 kB)
Collecting psycopg2-binary
  Downloading psycopg2_binary-2.9.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB)
     |████████████████████████████████| 3.4 MB 3.8 MB/s 
Requirement already satisfied: pytz in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[postgres]) (2021.1)
Requirement already satisfied: tzlocal in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[postgres]) (3.0)
Requirement already satisfied: six in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[postgres]) (1.15.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/python3/lib/python3.8/site-packages (from pydantic>=1.5.1->acryl-datahub[postgres]) (3.10.0.2)
Requirement already satisfied: websocket-client>=0.32.0 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub[postgres]) (0.57.0)
Requirement already satisfied: requests!=2.18.0,>=2.14.2 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub[postgres]) (2.25.1)
Requirement already satisfied: chardet<5,>=3.0.2 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[postgres]) (4.0.0)
Requirement already satisfied: idna<3,>=2.5 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[postgres]) (2.10)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[postgres]) (1.26.2)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[postgres]) (2020.12.5)
Collecting packaging
  Downloading packaging-21.0-py3-none-any.whl (40 kB)
     |████████████████████████████████| 40 kB 124 kB/s 
Collecting pyparsing>=2.0.2
  Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
     |████████████████████████████████| 67 kB 116 kB/s 
Requirement already satisfied: backports.zoneinfo in /usr/local/python3/lib/python3.8/site-packages (from tzlocal->avro-gen3==0.6.0->acryl-datahub[postgres]) (0.2.1)
Installing collected packages: pyparsing, sqlalchemy, packaging, psycopg2-binary, GeoAlchemy2
Successfully installed GeoAlchemy2-0.9.4 packaging-21.0 psycopg2-binary-2.9.1 pyparsing-2.4.7 sqlalchemy-1.3.24
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
mysql
python3 -m pip install 'acryl-datahub[mysql]'
Requirement already satisfied: acryl-datahub[mysql] in /usr/local/python3/lib/python3.8/site-packages (0.8.14.1)
Requirement already satisfied: pydantic>=1.5.1 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (1.8.2)
Requirement already satisfied: typing-inspect in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.7.1)
Requirement already satisfied: stackprinter in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.2.5)
Requirement already satisfied: tabulate in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.8.9)
Requirement already satisfied: click>=6.0.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (8.0.1)
Requirement already satisfied: entrypoints in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.3)
Requirement already satisfied: click-default-group in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (1.2.2)
Requirement already satisfied: mypy-extensions>=0.4.3 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.4.3)
Requirement already satisfied: python-dateutil>=2.8.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (2.8.2)
Requirement already satisfied: docker in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (4.4.1)
Requirement already satisfied: expandvars>=0.6.5 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.7.0)
Requirement already satisfied: toml>=0.10.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.10.2)
Requirement already satisfied: PyYAML in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (5.3.1)
Requirement already satisfied: avro-python3>=1.8.2 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (1.10.1)
Requirement already satisfied: avro-gen3==0.6.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.6.0)
Requirement already satisfied: sqlalchemy==1.3.24 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (1.3.24)
Collecting pymysql>=1.0.2
  Downloading PyMySQL-1.0.2-py3-none-any.whl (43 kB)
     |████████████████████████████████| 43 kB 18 kB/s 
Requirement already satisfied: tzlocal in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[mysql]) (3.0)
Requirement already satisfied: pytz in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[mysql]) (2021.1)
Requirement already satisfied: six in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[mysql]) (1.15.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/python3/lib/python3.8/site-packages (from pydantic>=1.5.1->acryl-datahub[mysql]) (3.10.0.2)
Requirement already satisfied: requests!=2.18.0,>=2.14.2 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub[mysql]) (2.25.1)
Requirement already satisfied: websocket-client>=0.32.0 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub[mysql]) (0.57.0)
Requirement already satisfied: idna<3,>=2.5 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[mysql]) (2.10)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[mysql]) (2020.12.5)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[mysql]) (1.26.2)
Requirement already satisfied: chardet<5,>=3.0.2 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[mysql]) (4.0.0)
Requirement already satisfied: backports.zoneinfo in /usr/local/python3/lib/python3.8/site-packages (from tzlocal->avro-gen3==0.6.0->acryl-datahub[mysql]) (0.2.1)
Installing collected packages: pymysql
Successfully installed pymysql-1.0.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
这个时候mysql和postgresql已经是非disabled的状态了
 python3 -m datahub check plugins
Sources:
athena
azure-ad
bigquery       (disabled)
bigquery-usage (disabled)
datahub-business-glossary
dbt
druid          (disabled)
feast
file
glue           (disabled)
hive           (disabled)
kafka          (disabled)
kafka-connect
ldap           (disabled)
looker         (disabled)
lookml         (disabled)
mongodb        (disabled)
mssql          (disabled)
mysql
okta           (disabled)
oracle         (disabled)
postgres
redash         (disabled)
redshift       (disabled)
sagemaker      (disabled)
snowflake      (disabled)
snowflake-usage(disabled)
sqlalchemy
superset

Sinks:
console
datahub-kafka  (disabled)
datahub-rest
file

Transformers:
add_dataset_ownership
add_dataset_tags
mark_dataset_status
pattern_add_dataset_ownership
set_dataset_browse_path
simple_add_dataset_ownership
simple_add_dataset_tags
simple_remove_dataset_ownership

For details on why a plugin is disabled, rerun with '--verbose'
If a plugin is disabled, try running: pip install 'acryl-datahub[<plugin>]'

运行第3个的时候有报错,但是再跑的时候好像又没有报错了

python3 -m pip install --upgrade acryl-datahub 
Requirement already satisfied: acryl-datahub in /usr/local/python3/lib/python3.8/site-packages (0.8.14.1)
Requirement already satisfied: docker in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (4.4.1)
Requirement already satisfied: python-dateutil>=2.8.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (2.8.2)
Requirement already satisfied: mypy-extensions>=0.4.3 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.4.3)
Requirement already satisfied: toml>=0.10.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.10.2)
Requirement already satisfied: PyYAML in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (5.3.1)
Requirement already satisfied: avro-python3>=1.8.2 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (1.10.1)
Requirement already satisfied: expandvars>=0.6.5 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.7.0)
Requirement already satisfied: click-default-group in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (1.2.2)
Requirement already satisfied: pydantic>=1.5.1 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (1.8.2)
Requirement already satisfied: click>=6.0.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (8.0.1)
Requirement already satisfied: typing-inspect in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.7.1)
Requirement already satisfied: entrypoints in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.3)
Requirement already satisfied: tabulate in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.8.9)
Requirement already satisfied: stackprinter in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.2.5)
Requirement already satisfied: avro-gen3==0.6.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.6.0)
Requirement already satisfied: tzlocal in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub) (3.0)
Requirement already satisfied: six in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub) (1.15.0)
Requirement already satisfied: pytz in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub) (2021.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/python3/lib/python3.8/site-packages (from pydantic>=1.5.1->acryl-datahub) (3.10.0.2)
Requirement already satisfied: requests!=2.18.0,>=2.14.2 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub) (2.25.1)
Requirement already satisfied: websocket-client>=0.32.0 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub) (0.57.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub) (1.26.2)
Requirement already satisfied: idna<3,>=2.5 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub) (2.10)
Requirement already satisfied: chardet<5,>=3.0.2 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub) (4.0.0)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub) (2020.12.5)
Requirement already satisfied: backports.zoneinfo in /usr/local/python3/lib/python3.8/site-packages (from tzlocal->avro-gen3==0.6.0->acryl-datahub) (0.2.1)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

是这个样子的

 python3 -m datahub version
DataHub CLI version: 0.8.14.1
Python version: 3.8.0 (default, Jan  4 2021, 16:47:18) 
[GCC 6.3.1 20170216 (Red Hat 6.3.1-3)]

安装docker

python3 -m datahub docker quickstart
 python3 -m datahub docker quickstart 
Fetching docker-compose file from GitHub
Datahub Neo4j volume found, starting with neo4j as graph service.
If you want to run using elastic, run `datahub docker nuke` and re-ingest your data.

Pulling elasticsearch          ... downloading (21.6%)
Pulling elasticsearch-setup    ... waiting
Pulling mysql                  ... waiting
Pulling datahub-gms            ... downloading (19.8%)
Pulling datahub-frontend-react ... downloading (24.5%)
Pulling mysql-setup            ... done
Pulling neo4j                  ... downloading (45.3%)
Pulling zookeeper              ... done
Pulling broker                 ... done
Pulling schema-registry        ... done
Pulling kafka-setup            ... extracting (100.0%)

这几天没有看就变样了啊,连安装方法都不一样了

查看所有镜像
 docker images

1、启动所有容器

docker start $(docker ps -a | awk '{ print $1}' | tail -n +2)

2、关闭所有容器

docker stop $(docker ps -a | awk '{ print $1}' | tail -n +2)

3、删除所有容器

docker rm $(docker ps -a | awk '{ print $1}' | tail -n +2)

4、删除所有镜像(慎用)

docker rmi $(docker images | awk '{print $3}' |tail -n +2)

systemctl status docker 

docker container ls

报错1

 python3 -m datahub docker quickstart 
Fetching docker-compose file from GitHub
No Datahub Neo4j volume found, starting with elasticsearch as graph service.
To use neo4j as a graph backend, run 
`datahub docker quickstart --quickstart-compose-file ./docker/quickstart/docker-compose.quickstart.yml`
from the root of the datahub repo

Pulling elasticsearch          ... done
Pulling elasticsearch-setup    ... done
Pulling mysql                  ... waiting
Pulling datahub-gms            ... waiting
Pulling datahub-frontend-react ... done
Pulling mysql-setup            ... done
Pulling zookeeper              ... done
Pulling broker                 ... done
Pulling schema-registry        ... done
Pulling kafka-setup            ... done

ERROR: for mysql  error pulling image configuration: unknown blob

ERROR: for datahub-gms  error pulling image configuration: unknown blob
ERROR: error pulling image configuration: unknown blob
[2021-09-22 16:20:45,776] ERROR    {datahub.entrypoints:99} - File "/usr/local/python3/lib/python3.8/site-packages/datahub/entrypoints.py", line 91, in main
    88   def main(**kwargs):
    89       # This wrapper prevents click from suppressing errors.
    90       try:
--> 91           sys.exit(datahub(standalone_mode=False, **kwargs))
    92       except click.exceptions.Abort:
    ..................................................
     kwargs = {'prog_name': 'python3 -m datahub'}
     datahub = <Group datahub>
     click.exceptions.Abort = <class 'click.exceptions.Abort'>
    ..................................................

File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 829, in __call__
    827  def __call__(self, *args, **kwargs):
 (...)
--> 829      return self.main(*args, **kwargs)
    ..................................................
     self = <Group datahub>
     args = ()
     kwargs = {'standalone_mode': False,
               'prog_name': 'python3 -m datahub'}
    ..................................................

File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
File "/usr/local/python3/lib/python3.8/site-packages/datahub/cli/docker.py", line 196, in quickstart
    145  def quickstart(
    146      version: str,
    147      build_locally: bool,
    148      quickstart_compose_file: List[pathlib.Path],
    149      dump_logs_on_failure: bool,
    150      graph_service_impl: Optional[str],
    151  ) -> None:
 (...)
    192          "datahub",
    193      ]
    194  
    195      # Pull and possibly build the latest containers.
--> 196      subprocess.run(
    197          [
    ..................................................
     quickstart = <Command quickstart>
     version = 'head'
     build_locally = False
     quickstart_compose_file = [PosixPath('/tmp/tmpttnj9c2j.yml'), ]
     List = typing.List
     pathlib.Path = <class 'pathlib.Path'>
     dump_logs_on_failure = False
     graph_service_impl = None
     Optional = typing.Optional
     subprocess.run = <function 'run' subprocess.py:448>
    ..................................................

File "/usr/local/python3/lib/python3.8/subprocess.py", line 512, in run
    448  def run(*popenargs,
    449          input=None, capture_output=False, timeout=None, check=False, **kwargs):
 (...)
    508              # We don't call process.wait() as .__exit__ does that for us.
    509              raise
    510          retcode = process.poll()
    511          if check and retcode:
--> 512              raise CalledProcessError(retcode, process.args,
    513                                       output=stdout, stderr=stderr)
    ..................................................
     popenargs = (['docker-compose', '-f', '/tmp/tmpttnj9c2j.yml', '-p', 'datahub', 'pull', ], )
     input = None
     capture_output = False
     timeout = None
     check = True
     kwargs = {}
     retcode = 1
     process.poll = <method 'Popen.poll' of <subprocess.Popen object at 0x7f1501171be0> subprocess.py:1048>
     CalledProcessError = <class 'subprocess.CalledProcessError'>
     process.args = ['docker-compose', '-f', '/tmp/tmpttnj9c2j.yml', '-p', 'datahub', 'pull', ]
     stdout = None
     stderr = None
    ..................................................

---- (full traceback above) ----
File "/usr/local/python3/lib/python3.8/site-packages/datahub/entrypoints.py", line 91, in main
    sys.exit(datahub(standalone_mode=False, **kwargs))
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
File "/usr/local/python3/lib/python3.8/site-packages/datahub/cli/docker.py", line 196, in quickstart
    subprocess.run(
File "/usr/local/python3/lib/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,

CalledProcessError: Command '['docker-compose', '-f', '/tmp/tmpttnj9c2j.yml', '-p', 'datahub', 'pull']' returned non-zero exit status 1.

跟以下好像都没有关系,升吧,无所谓

python3 -m pip install pyopenssl ndg-httpsclient pyasn1

python3 -m pip install -U urllib3

python3 -m pip install -U channels

python3 -m pip --cert /Users/user/cacert.pem install -U channels

python3 -m pip install requests[security]

核心问题是这个!!!!docker启用了国内源!!!或者说只有国内源,因此建议暂时关闭docker的国内源!

cp /etc/docker/daemon.json  /etc/docker/daemon.jsonbak
rm /etc/docker/daemon.json 
systemctl restart docker

一切正常

python3 -m datahub docker quickstart 
Fetching docker-compose file from GitHub
No Datahub Neo4j volume found, starting with elasticsearch as graph service.
To use neo4j as a graph backend, run 
`datahub docker quickstart --quickstart-compose-file ./docker/quickstart/docker-compose.quickstart.yml`
from the root of the datahub repo

Pulling elasticsearch          ... done
Pulling elasticsearch-setup    ... done
Pulling mysql                  ... done
Pulling datahub-gms            ... done
Pulling datahub-frontend-react ... done
Pulling mysql-setup            ... done
Pulling zookeeper              ... done
Pulling broker                 ... done
Pulling schema-registry        ... done
Pulling kafka-setup            ... done

Creating network "datahub_network" with the default driver
Creating volume "datahub_esdata" with default driver
Creating volume "datahub_mysqldata" with default driver
Creating volume "datahub_zkdata" with default driver
Creating mysql         ... done
Creating zookeeper     ... done
Creating elasticsearch ... done
Creating datahub-gms         ... done
Creating elasticsearch-setup ... done
Creating broker              ... done
Creating mysql-setup         ... done
Creating datahub-frontend-react ... done
Creating schema-registry        ... done
Creating kafka-setup            ... done
....
elasticsearch is up-to-date
mysql is up-to-date
zookeeper is up-to-date
elasticsearch-setup is up-to-date
mysql-setup is up-to-date
datahub-gms is up-to-date
broker is up-to-date
datahub-frontend-react is up-to-date
schema-registry is up-to-date
kafka-setup is up-to-date
.............
zookeeper is up-to-date
Starting mysql ... 
elasticsearch is up-to-date
broker is up-to-date
elasticsearch-setup is up-to-date
schema-registry is up-to-date
Starting mysql ... done
mysql-setup is up-to-date
datahub-gms is up-to-date
datahub-frontend-react is up-to-date
.........
zookeeper is up-to-date
mysql is up-to-date
elasticsearch is up-to-date
broker is up-to-date
datahub-gms is up-to-date
Starting mysql-setup ... 
Starting elasticsearch-setup ... 
schema-registry is up-to-date
Starting mysql-setup         ... done
Starting elasticsearch-setup ... done
...........
elasticsearch is up-to-date
mysql is up-to-date
Starting elasticsearch-setup ... 
zookeeper is up-to-date
Starting mysql-setup         ... 
datahub-gms is up-to-date
broker is up-to-date
Starting elasticsearch-setup ... done
Starting mysql-setup         ... done
Starting kafka-setup         ... done
.............
zookeeper is up-to-date
mysql is up-to-date
elasticsearch is up-to-date
broker is up-to-date
Starting mysql-setup ... 
datahub-gms is up-to-date
Starting elasticsearch-setup ... 
schema-registry is up-to-date
Starting mysql-setup         ... done
Starting elasticsearch-setup ... done
.......
✔ DataHub is now running
Ingest some demo data using `datahub docker ingest-sample-data`,
or head to http://localhost:9002 (username: datahub, password: datahub) to play around with the frontend.
Need support? Get in touch on Slack: https://slack.datahubproject.io/

截图留念

微信截图_20210922163316.png
©著作权归作者所有,转载或内容合作请联系作者
  • 序言:七十年代末,一起剥皮案震惊了整个滨河市,随后出现的几起案子,更是在滨河造成了极大的恐慌,老刑警刘岩,带你破解...
    沈念sama阅读 211,042评论 6 490
  • 序言:滨河连续发生了三起死亡事件,死亡现场离奇诡异,居然都是意外死亡,警方通过查阅死者的电脑和手机,发现死者居然都...
    沈念sama阅读 89,996评论 2 384
  • 文/潘晓璐 我一进店门,熙熙楼的掌柜王于贵愁眉苦脸地迎上来,“玉大人,你说我怎么就摊上这事。” “怎么了?”我有些...
    开封第一讲书人阅读 156,674评论 0 345
  • 文/不坏的土叔 我叫张陵,是天一观的道长。 经常有香客问我,道长,这世上最难降的妖魔是什么? 我笑而不...
    开封第一讲书人阅读 56,340评论 1 283
  • 正文 为了忘掉前任,我火速办了婚礼,结果婚礼上,老公的妹妹穿的比我还像新娘。我一直安慰自己,他们只是感情好,可当我...
    茶点故事阅读 65,404评论 5 384
  • 文/花漫 我一把揭开白布。 她就那样静静地躺着,像睡着了一般。 火红的嫁衣衬着肌肤如雪。 梳的纹丝不乱的头发上,一...
    开封第一讲书人阅读 49,749评论 1 289
  • 那天,我揣着相机与录音,去河边找鬼。 笑死,一个胖子当着我的面吹牛,可吹牛的内容都是我干的。 我是一名探鬼主播,决...
    沈念sama阅读 38,902评论 3 405
  • 文/苍兰香墨 我猛地睁开眼,长吁一口气:“原来是场噩梦啊……” “哼!你这毒妇竟也来了?” 一声冷哼从身侧响起,我...
    开封第一讲书人阅读 37,662评论 0 266
  • 序言:老挝万荣一对情侣失踪,失踪者是张志新(化名)和其女友刘颖,没想到半个月后,有当地人在树林里发现了一具尸体,经...
    沈念sama阅读 44,110评论 1 303
  • 正文 独居荒郊野岭守林人离奇死亡,尸身上长有42处带血的脓包…… 初始之章·张勋 以下内容为张勋视角 年9月15日...
    茶点故事阅读 36,451评论 2 325
  • 正文 我和宋清朗相恋三年,在试婚纱的时候发现自己被绿了。 大学时的朋友给我发了我未婚夫和他白月光在一起吃饭的照片。...
    茶点故事阅读 38,577评论 1 340
  • 序言:一个原本活蹦乱跳的男人离奇死亡,死状恐怖,灵堂内的尸体忽然破棺而出,到底是诈尸还是另有隐情,我是刑警宁泽,带...
    沈念sama阅读 34,258评论 4 328
  • 正文 年R本政府宣布,位于F岛的核电站,受9级特大地震影响,放射性物质发生泄漏。R本人自食恶果不足惜,却给世界环境...
    茶点故事阅读 39,848评论 3 312
  • 文/蒙蒙 一、第九天 我趴在偏房一处隐蔽的房顶上张望。 院中可真热闹,春花似锦、人声如沸。这庄子的主人今日做“春日...
    开封第一讲书人阅读 30,726评论 0 21
  • 文/苍兰香墨 我抬头看了看天上的太阳。三九已至,却和暖如春,着一层夹袄步出监牢的瞬间,已是汗流浃背。 一阵脚步声响...
    开封第一讲书人阅读 31,952评论 1 264
  • 我被黑心中介骗来泰国打工, 没想到刚下飞机就差点儿被人妖公主榨干…… 1. 我叫王不留,地道东北人。 一个月前我还...
    沈念sama阅读 46,271评论 2 360
  • 正文 我出身青楼,却偏偏与公主长得像,于是被迫代替她去往敌国和亲。 传闻我的和亲对象是个残疾皇子,可洞房花烛夜当晚...
    茶点故事阅读 43,452评论 2 348

推荐阅读更多精彩内容