好像跟之前我写的那个在安装上有区别
修改pip 源
建议用阿里云的源,豆瓣源有问题
python3 -m pip config set global.index-url https://mirrors.aliyun.com/pypi/simple/
Writing to /root/.config/pip/pip.conf
或者
python3 -m pip install -i http://pypi.douban.com/simple --trusted-host pypi.douban.com
参考官方文档
python3 -m pip install --upgrade pip wheel setuptools
python3 -m pip uninstall datahub acryl-datahub || true # sanity check - ok if it fails
python3 -m pip install --upgrade acryl-datahubdatahub version
插件检测及安装
python3 -m datahub check plugins
Sources:
athena (disabled)
azure-ad
bigquery (disabled)
bigquery-usage (disabled)
datahub-business-glossary
dbt
druid (disabled)
feast
file
glue (disabled)
hive (disabled)
kafka (disabled)
kafka-connect (disabled)
ldap (disabled)
looker (disabled)
lookml (disabled)
mongodb (disabled)
mssql (disabled)
mysql (disabled)
okta (disabled)
oracle (disabled)
postgres (disabled)
redash (disabled)
redshift (disabled)
sagemaker (disabled)
snowflake (disabled)
snowflake-usage(disabled)
sqlalchemy (disabled)
superset
Sinks:
console
datahub-kafka (disabled)
datahub-rest
file
Transformers:
add_dataset_ownership
add_dataset_tags
mark_dataset_status
pattern_add_dataset_ownership
set_dataset_browse_path
simple_add_dataset_ownership
simple_add_dataset_tags
simple_remove_dataset_ownership
For details on why a plugin is disabled, rerun with '--verbose'
If a plugin is disabled, try running: pip install 'acryl-datahub[<plugin>]'
根据官方文档安装mysql及postgresql插件
python3 -m pip install 'acryl-datahub[postgres]'
python3 -m pip install 'acryl-datahub[mysql]'
postgresql
python3 -m pip install 'acryl-datahub[postgres]'
Requirement already satisfied: acryl-datahub[postgres] in /usr/local/python3/lib/python3.8/site-packages (0.8.14.1)
Requirement already satisfied: typing-inspect in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.7.1)
Requirement already satisfied: entrypoints in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.3)
Requirement already satisfied: toml>=0.10.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.10.2)
Requirement already satisfied: tabulate in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.8.9)
Requirement already satisfied: mypy-extensions>=0.4.3 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.4.3)
Requirement already satisfied: expandvars>=0.6.5 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.7.0)
Requirement already satisfied: python-dateutil>=2.8.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (2.8.2)
Requirement already satisfied: avro-python3>=1.8.2 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (1.10.1)
Requirement already satisfied: pydantic>=1.5.1 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (1.8.2)
Requirement already satisfied: click>=6.0.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (8.0.1)
Requirement already satisfied: click-default-group in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (1.2.2)
Requirement already satisfied: stackprinter in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.2.5)
Requirement already satisfied: docker in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (4.4.1)
Requirement already satisfied: PyYAML in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (5.3.1)
Requirement already satisfied: avro-gen3==0.6.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[postgres]) (0.6.0)
Collecting sqlalchemy==1.3.24
Downloading SQLAlchemy-1.3.24-cp38-cp38-manylinux2010_x86_64.whl (1.3 MB)
|████████████████████████████████| 1.3 MB 194 kB/s
Collecting GeoAlchemy2
Downloading GeoAlchemy2-0.9.4-py2.py3-none-any.whl (32 kB)
Collecting psycopg2-binary
Downloading psycopg2_binary-2.9.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB)
|████████████████████████████████| 3.4 MB 3.8 MB/s
Requirement already satisfied: pytz in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[postgres]) (2021.1)
Requirement already satisfied: tzlocal in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[postgres]) (3.0)
Requirement already satisfied: six in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[postgres]) (1.15.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/python3/lib/python3.8/site-packages (from pydantic>=1.5.1->acryl-datahub[postgres]) (3.10.0.2)
Requirement already satisfied: websocket-client>=0.32.0 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub[postgres]) (0.57.0)
Requirement already satisfied: requests!=2.18.0,>=2.14.2 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub[postgres]) (2.25.1)
Requirement already satisfied: chardet<5,>=3.0.2 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[postgres]) (4.0.0)
Requirement already satisfied: idna<3,>=2.5 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[postgres]) (2.10)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[postgres]) (1.26.2)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[postgres]) (2020.12.5)
Collecting packaging
Downloading packaging-21.0-py3-none-any.whl (40 kB)
|████████████████████████████████| 40 kB 124 kB/s
Collecting pyparsing>=2.0.2
Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
|████████████████████████████████| 67 kB 116 kB/s
Requirement already satisfied: backports.zoneinfo in /usr/local/python3/lib/python3.8/site-packages (from tzlocal->avro-gen3==0.6.0->acryl-datahub[postgres]) (0.2.1)
Installing collected packages: pyparsing, sqlalchemy, packaging, psycopg2-binary, GeoAlchemy2
Successfully installed GeoAlchemy2-0.9.4 packaging-21.0 psycopg2-binary-2.9.1 pyparsing-2.4.7 sqlalchemy-1.3.24
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
mysql
python3 -m pip install 'acryl-datahub[mysql]'
Requirement already satisfied: acryl-datahub[mysql] in /usr/local/python3/lib/python3.8/site-packages (0.8.14.1)
Requirement already satisfied: pydantic>=1.5.1 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (1.8.2)
Requirement already satisfied: typing-inspect in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.7.1)
Requirement already satisfied: stackprinter in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.2.5)
Requirement already satisfied: tabulate in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.8.9)
Requirement already satisfied: click>=6.0.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (8.0.1)
Requirement already satisfied: entrypoints in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.3)
Requirement already satisfied: click-default-group in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (1.2.2)
Requirement already satisfied: mypy-extensions>=0.4.3 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.4.3)
Requirement already satisfied: python-dateutil>=2.8.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (2.8.2)
Requirement already satisfied: docker in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (4.4.1)
Requirement already satisfied: expandvars>=0.6.5 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.7.0)
Requirement already satisfied: toml>=0.10.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.10.2)
Requirement already satisfied: PyYAML in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (5.3.1)
Requirement already satisfied: avro-python3>=1.8.2 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (1.10.1)
Requirement already satisfied: avro-gen3==0.6.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (0.6.0)
Requirement already satisfied: sqlalchemy==1.3.24 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub[mysql]) (1.3.24)
Collecting pymysql>=1.0.2
Downloading PyMySQL-1.0.2-py3-none-any.whl (43 kB)
|████████████████████████████████| 43 kB 18 kB/s
Requirement already satisfied: tzlocal in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[mysql]) (3.0)
Requirement already satisfied: pytz in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[mysql]) (2021.1)
Requirement already satisfied: six in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub[mysql]) (1.15.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/python3/lib/python3.8/site-packages (from pydantic>=1.5.1->acryl-datahub[mysql]) (3.10.0.2)
Requirement already satisfied: requests!=2.18.0,>=2.14.2 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub[mysql]) (2.25.1)
Requirement already satisfied: websocket-client>=0.32.0 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub[mysql]) (0.57.0)
Requirement already satisfied: idna<3,>=2.5 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[mysql]) (2.10)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[mysql]) (2020.12.5)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[mysql]) (1.26.2)
Requirement already satisfied: chardet<5,>=3.0.2 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub[mysql]) (4.0.0)
Requirement already satisfied: backports.zoneinfo in /usr/local/python3/lib/python3.8/site-packages (from tzlocal->avro-gen3==0.6.0->acryl-datahub[mysql]) (0.2.1)
Installing collected packages: pymysql
Successfully installed pymysql-1.0.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
这个时候mysql和postgresql已经是非disabled的状态了
python3 -m datahub check plugins
Sources:
athena
azure-ad
bigquery (disabled)
bigquery-usage (disabled)
datahub-business-glossary
dbt
druid (disabled)
feast
file
glue (disabled)
hive (disabled)
kafka (disabled)
kafka-connect
ldap (disabled)
looker (disabled)
lookml (disabled)
mongodb (disabled)
mssql (disabled)
mysql
okta (disabled)
oracle (disabled)
postgres
redash (disabled)
redshift (disabled)
sagemaker (disabled)
snowflake (disabled)
snowflake-usage(disabled)
sqlalchemy
superset
Sinks:
console
datahub-kafka (disabled)
datahub-rest
file
Transformers:
add_dataset_ownership
add_dataset_tags
mark_dataset_status
pattern_add_dataset_ownership
set_dataset_browse_path
simple_add_dataset_ownership
simple_add_dataset_tags
simple_remove_dataset_ownership
For details on why a plugin is disabled, rerun with '--verbose'
If a plugin is disabled, try running: pip install 'acryl-datahub[<plugin>]'
运行第3个的时候有报错,但是再跑的时候好像又没有报错了
python3 -m pip install --upgrade acryl-datahub
Requirement already satisfied: acryl-datahub in /usr/local/python3/lib/python3.8/site-packages (0.8.14.1)
Requirement already satisfied: docker in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (4.4.1)
Requirement already satisfied: python-dateutil>=2.8.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (2.8.2)
Requirement already satisfied: mypy-extensions>=0.4.3 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.4.3)
Requirement already satisfied: toml>=0.10.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.10.2)
Requirement already satisfied: PyYAML in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (5.3.1)
Requirement already satisfied: avro-python3>=1.8.2 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (1.10.1)
Requirement already satisfied: expandvars>=0.6.5 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.7.0)
Requirement already satisfied: click-default-group in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (1.2.2)
Requirement already satisfied: pydantic>=1.5.1 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (1.8.2)
Requirement already satisfied: click>=6.0.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (8.0.1)
Requirement already satisfied: typing-inspect in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.7.1)
Requirement already satisfied: entrypoints in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.3)
Requirement already satisfied: tabulate in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.8.9)
Requirement already satisfied: stackprinter in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.2.5)
Requirement already satisfied: avro-gen3==0.6.0 in /usr/local/python3/lib/python3.8/site-packages (from acryl-datahub) (0.6.0)
Requirement already satisfied: tzlocal in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub) (3.0)
Requirement already satisfied: six in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub) (1.15.0)
Requirement already satisfied: pytz in /usr/local/python3/lib/python3.8/site-packages (from avro-gen3==0.6.0->acryl-datahub) (2021.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/python3/lib/python3.8/site-packages (from pydantic>=1.5.1->acryl-datahub) (3.10.0.2)
Requirement already satisfied: requests!=2.18.0,>=2.14.2 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub) (2.25.1)
Requirement already satisfied: websocket-client>=0.32.0 in /usr/local/python3/lib/python3.8/site-packages (from docker->acryl-datahub) (0.57.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub) (1.26.2)
Requirement already satisfied: idna<3,>=2.5 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub) (2.10)
Requirement already satisfied: chardet<5,>=3.0.2 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub) (4.0.0)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/python3/lib/python3.8/site-packages (from requests!=2.18.0,>=2.14.2->docker->acryl-datahub) (2020.12.5)
Requirement already satisfied: backports.zoneinfo in /usr/local/python3/lib/python3.8/site-packages (from tzlocal->avro-gen3==0.6.0->acryl-datahub) (0.2.1)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
是这个样子的
python3 -m datahub version
DataHub CLI version: 0.8.14.1
Python version: 3.8.0 (default, Jan 4 2021, 16:47:18)
[GCC 6.3.1 20170216 (Red Hat 6.3.1-3)]
安装docker
python3 -m datahub docker quickstart
python3 -m datahub docker quickstart
Fetching docker-compose file from GitHub
Datahub Neo4j volume found, starting with neo4j as graph service.
If you want to run using elastic, run `datahub docker nuke` and re-ingest your data.
Pulling elasticsearch ... downloading (21.6%)
Pulling elasticsearch-setup ... waiting
Pulling mysql ... waiting
Pulling datahub-gms ... downloading (19.8%)
Pulling datahub-frontend-react ... downloading (24.5%)
Pulling mysql-setup ... done
Pulling neo4j ... downloading (45.3%)
Pulling zookeeper ... done
Pulling broker ... done
Pulling schema-registry ... done
Pulling kafka-setup ... extracting (100.0%)
这几天没有看就变样了啊,连安装方法都不一样了
查看所有镜像
docker images
1、启动所有容器
docker start $(docker ps -a | awk '{ print $1}' | tail -n +2)
2、关闭所有容器
docker stop $(docker ps -a | awk '{ print $1}' | tail -n +2)
3、删除所有容器
docker rm $(docker ps -a | awk '{ print $1}' | tail -n +2)
4、删除所有镜像(慎用)
docker rmi $(docker images | awk '{print $3}' |tail -n +2)
systemctl status docker
docker container ls
报错1
python3 -m datahub docker quickstart
Fetching docker-compose file from GitHub
No Datahub Neo4j volume found, starting with elasticsearch as graph service.
To use neo4j as a graph backend, run
`datahub docker quickstart --quickstart-compose-file ./docker/quickstart/docker-compose.quickstart.yml`
from the root of the datahub repo
Pulling elasticsearch ... done
Pulling elasticsearch-setup ... done
Pulling mysql ... waiting
Pulling datahub-gms ... waiting
Pulling datahub-frontend-react ... done
Pulling mysql-setup ... done
Pulling zookeeper ... done
Pulling broker ... done
Pulling schema-registry ... done
Pulling kafka-setup ... done
ERROR: for mysql error pulling image configuration: unknown blob
ERROR: for datahub-gms error pulling image configuration: unknown blob
ERROR: error pulling image configuration: unknown blob
[2021-09-22 16:20:45,776] ERROR {datahub.entrypoints:99} - File "/usr/local/python3/lib/python3.8/site-packages/datahub/entrypoints.py", line 91, in main
88 def main(**kwargs):
89 # This wrapper prevents click from suppressing errors.
90 try:
--> 91 sys.exit(datahub(standalone_mode=False, **kwargs))
92 except click.exceptions.Abort:
..................................................
kwargs = {'prog_name': 'python3 -m datahub'}
datahub = <Group datahub>
click.exceptions.Abort = <class 'click.exceptions.Abort'>
..................................................
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 829, in __call__
827 def __call__(self, *args, **kwargs):
(...)
--> 829 return self.main(*args, **kwargs)
..................................................
self = <Group datahub>
args = ()
kwargs = {'standalone_mode': False,
'prog_name': 'python3 -m datahub'}
..................................................
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/usr/local/python3/lib/python3.8/site-packages/datahub/cli/docker.py", line 196, in quickstart
145 def quickstart(
146 version: str,
147 build_locally: bool,
148 quickstart_compose_file: List[pathlib.Path],
149 dump_logs_on_failure: bool,
150 graph_service_impl: Optional[str],
151 ) -> None:
(...)
192 "datahub",
193 ]
194
195 # Pull and possibly build the latest containers.
--> 196 subprocess.run(
197 [
..................................................
quickstart = <Command quickstart>
version = 'head'
build_locally = False
quickstart_compose_file = [PosixPath('/tmp/tmpttnj9c2j.yml'), ]
List = typing.List
pathlib.Path = <class 'pathlib.Path'>
dump_logs_on_failure = False
graph_service_impl = None
Optional = typing.Optional
subprocess.run = <function 'run' subprocess.py:448>
..................................................
File "/usr/local/python3/lib/python3.8/subprocess.py", line 512, in run
448 def run(*popenargs,
449 input=None, capture_output=False, timeout=None, check=False, **kwargs):
(...)
508 # We don't call process.wait() as .__exit__ does that for us.
509 raise
510 retcode = process.poll()
511 if check and retcode:
--> 512 raise CalledProcessError(retcode, process.args,
513 output=stdout, stderr=stderr)
..................................................
popenargs = (['docker-compose', '-f', '/tmp/tmpttnj9c2j.yml', '-p', 'datahub', 'pull', ], )
input = None
capture_output = False
timeout = None
check = True
kwargs = {}
retcode = 1
process.poll = <method 'Popen.poll' of <subprocess.Popen object at 0x7f1501171be0> subprocess.py:1048>
CalledProcessError = <class 'subprocess.CalledProcessError'>
process.args = ['docker-compose', '-f', '/tmp/tmpttnj9c2j.yml', '-p', 'datahub', 'pull', ]
stdout = None
stderr = None
..................................................
---- (full traceback above) ----
File "/usr/local/python3/lib/python3.8/site-packages/datahub/entrypoints.py", line 91, in main
sys.exit(datahub(standalone_mode=False, **kwargs))
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/python3/lib/python3.8/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/usr/local/python3/lib/python3.8/site-packages/datahub/cli/docker.py", line 196, in quickstart
subprocess.run(
File "/usr/local/python3/lib/python3.8/subprocess.py", line 512, in run
raise CalledProcessError(retcode, process.args,
CalledProcessError: Command '['docker-compose', '-f', '/tmp/tmpttnj9c2j.yml', '-p', 'datahub', 'pull']' returned non-zero exit status 1.
跟以下好像都没有关系,升吧,无所谓
python3 -m pip install pyopenssl ndg-httpsclient pyasn1
python3 -m pip install -U urllib3
python3 -m pip install -U channels
python3 -m pip --cert /Users/user/cacert.pem install -U channels
python3 -m pip install requests[security]
核心问题是这个!!!!docker启用了国内源!!!或者说只有国内源,因此建议暂时关闭docker的国内源!
cp /etc/docker/daemon.json /etc/docker/daemon.jsonbak
rm /etc/docker/daemon.json
systemctl restart docker
一切正常
python3 -m datahub docker quickstart
Fetching docker-compose file from GitHub
No Datahub Neo4j volume found, starting with elasticsearch as graph service.
To use neo4j as a graph backend, run
`datahub docker quickstart --quickstart-compose-file ./docker/quickstart/docker-compose.quickstart.yml`
from the root of the datahub repo
Pulling elasticsearch ... done
Pulling elasticsearch-setup ... done
Pulling mysql ... done
Pulling datahub-gms ... done
Pulling datahub-frontend-react ... done
Pulling mysql-setup ... done
Pulling zookeeper ... done
Pulling broker ... done
Pulling schema-registry ... done
Pulling kafka-setup ... done
Creating network "datahub_network" with the default driver
Creating volume "datahub_esdata" with default driver
Creating volume "datahub_mysqldata" with default driver
Creating volume "datahub_zkdata" with default driver
Creating mysql ... done
Creating zookeeper ... done
Creating elasticsearch ... done
Creating datahub-gms ... done
Creating elasticsearch-setup ... done
Creating broker ... done
Creating mysql-setup ... done
Creating datahub-frontend-react ... done
Creating schema-registry ... done
Creating kafka-setup ... done
....
elasticsearch is up-to-date
mysql is up-to-date
zookeeper is up-to-date
elasticsearch-setup is up-to-date
mysql-setup is up-to-date
datahub-gms is up-to-date
broker is up-to-date
datahub-frontend-react is up-to-date
schema-registry is up-to-date
kafka-setup is up-to-date
.............
zookeeper is up-to-date
Starting mysql ...
elasticsearch is up-to-date
broker is up-to-date
elasticsearch-setup is up-to-date
schema-registry is up-to-date
Starting mysql ... done
mysql-setup is up-to-date
datahub-gms is up-to-date
datahub-frontend-react is up-to-date
.........
zookeeper is up-to-date
mysql is up-to-date
elasticsearch is up-to-date
broker is up-to-date
datahub-gms is up-to-date
Starting mysql-setup ...
Starting elasticsearch-setup ...
schema-registry is up-to-date
Starting mysql-setup ... done
Starting elasticsearch-setup ... done
...........
elasticsearch is up-to-date
mysql is up-to-date
Starting elasticsearch-setup ...
zookeeper is up-to-date
Starting mysql-setup ...
datahub-gms is up-to-date
broker is up-to-date
Starting elasticsearch-setup ... done
Starting mysql-setup ... done
Starting kafka-setup ... done
.............
zookeeper is up-to-date
mysql is up-to-date
elasticsearch is up-to-date
broker is up-to-date
Starting mysql-setup ...
datahub-gms is up-to-date
Starting elasticsearch-setup ...
schema-registry is up-to-date
Starting mysql-setup ... done
Starting elasticsearch-setup ... done
.......
✔ DataHub is now running
Ingest some demo data using `datahub docker ingest-sample-data`,
or head to http://localhost:9002 (username: datahub, password: datahub) to play around with the frontend.
Need support? Get in touch on Slack: https://slack.datahubproject.io/