Windows over WSL - install log
Logging here my install experience on Windows, using WSL (as of 11/12/2020 using ubuntu 18.04 on Windows WSL):
👎 )
Meltano Install (Windows Native - doesn't work PS C:\Files\Source\slalom-data-platform-core\data\taps> pipx install meltano
** On entry to DGEBAL parameter number 3 had an illegal value
** On entry to DGEHRD parameter number 2 had an illegal value
** On entry to DORGHR DORGQR parameter number 2 had an illegal value
** On entry to DHSEQR parameter number 4 had an illegal value
ERROR: Command errored out with exit status 1:
command: 'C:\Users\aaron.steers\.local\pipx\venvs\meltano\Scripts\python.exe' 'C:\Users\aaron.steers\.local\pipx\shared\Lib\site-packages\pip\_vendor\pep517\_in_process.py' get_requires_for_build_wheel 'C:\Users\AARON~1.STE\AppData\Local\Temp\tmp6k6xq2a0'
cwd: C:\Users\aaron.steers\AppData\Local\Temp\pip-install-tgz1ls1p\snowflake-connector-python
Complete output (26 lines):
Traceback (most recent call last):
File "C:\Users\aaron.steers\.local\pipx\shared\Lib\site-packages\pip\_vendor\pep517\_in_process.py", line 280, in <module>
main()
File "C:\Users\aaron.steers\.local\pipx\shared\Lib\site-packages\pip\_vendor\pep517\_in_process.py", line 263, in main
File "C:\Users\aaron.steers\.local\pipx\shared\Lib\site-packages\pip\_vendor\pep517\_in_process.py", line 114, in get_requires_for_build_wheel
return hook(config_settings)
File "C:\Users\aaron.steers\AppData\Local\Temp\pip-build-env-gtck3vek\overlay\Lib\site-packages\setuptools\build_meta.py", line 149, in get_requires_for_build_wheel
return self._get_build_requires(
File "C:\Users\aaron.steers\AppData\Local\Temp\pip-build-env-gtck3vek\overlay\Lib\site-packages\setuptools\build_meta.py", line 130, in _get_build_requires
self.run_setup()
File "C:\Users\aaron.steers\AppData\Local\Temp\pip-build-env-gtck3vek\overlay\Lib\site-packages\setuptools\build_meta.py", line 253, in run_setup super(_BuildMetaLegacyBackend,
File "C:\Users\aaron.steers\AppData\Local\Temp\pip-build-env-gtck3vek\overlay\Lib\site-packages\setuptools\build_meta.py", line 145, in run_setup exec(compile(code, __file__, 'exec'), locals())
File "setup.py", line 52, in <module>
import pyarrow
File "C:\Users\aaron.steers\AppData\Local\Temp\pip-build-env-gtck3vek\overlay\Lib\site-packages\pyarrow\__init__.py", line 58, in <module>
import pyarrow.compat as compat
File "C:\Users\aaron.steers\AppData\Local\Temp\pip-build-env-gtck3vek\overlay\Lib\site-packages\pyarrow\compat.py", line 24, in <module>
import numpy as np
File "C:\Users\aaron.steers\AppData\Local\Temp\pip-build-env-gtck3vek\overlay\Lib\site-packages\numpy\__init__.py", line 305, in <module>
_win_os_check()
File "C:\Users\aaron.steers\AppData\Local\Temp\pip-build-env-gtck3vek\overlay\Lib\site-packages\numpy\__init__.py", line 302, in _win_os_check
raise RuntimeError(msg.format(__file__)) from None
RuntimeError: The current Numpy installation ('C:\\Users\\aaron.steers\\AppData\\Local\\Temp\\pip-build-env-gtck3vek\\overlay\\Lib\\site-packages\\numpy\\__init__.py') fails to pass a sanity check due to a bug in the windows runtime. See this issue for more information: https://tinyurl.com/y3dm3h86
----------------------------------------
ERROR: Command errored out with exit status 1: 'C:\Users\aaron.steers\.local\pipx\venvs\meltano\Scripts\python.exe' 'C:\Users\aaron.steers\.local\pipx\shared\Lib\site-packages\pip\_vendor\pep517\_in_process.py' get_requires_for_build_wheel 'C:\Users\AARON~1.STE\AppData\Local\Temp\tmp6k6xq2a0' Check the logs for full command output.
👍 )
Meltano Install (WSL - works ajsteers@D520977490:/mnt/c/WINDOWS/system32$ pipx install meltano
installed package meltano 1.58.0, Python 3.6.8
These apps are now globally available
- alembic
- chardetect
- dotenv
- flask
- gitlab
- gunicorn
- gunicorn_paster
- jp.py
- jsonschema
- mako-render
- markdown_py
- meltano
- pybabel
- pyhocon
- pyjwt
- snowflake-dump-certs
- snowflake-dump-ocsp-response
- snowflake-dump-ocsp-response-cache
- snowflake-export-certs
- sqlformat
- watchmedo
done! ✨ 🌟 ✨
(Success!
👍 )
Meltano Init (Works ajsteers@D520977490:/mnt/c/Files/Source/slalom-data-platform-core/data/taps$ meltano init slalom-data-platform
Created slalom-data-platform
Creating project files...
Created slalom-data-platform/meltano.yml
Created slalom-data-platform/README.md
Created slalom-data-platform/requirements.txt
Created slalom-data-platform/.gitignore
Created slalom-data-platform/model/.gitkeep
Created slalom-data-platform/extract/.gitkeep
Created slalom-data-platform/load/.gitkeep
Created slalom-data-platform/transform/.gitkeep
Created slalom-data-platform/analyze/.gitkeep
Created slalom-data-platform/notebook/.gitkeep
Created slalom-data-platform/orchestrate/.gitkeep
Creating system database...
[2020-11-12 17:13:32,189] [627|MainThread|alembic.runtime.migration] [INFO] Context impl SQLiteImpl.
[2020-11-12 17:13:32,190] [627|MainThread|alembic.runtime.migration] [INFO] Will assume non-transactional DDL.
Upgrading database to e4fbabc3fed6
[2020-11-12 17:13:32,216] [627|MainThread|alembic.runtime.migration] [INFO] Context impl SQLiteImpl.
[2020-11-12 17:13:32,216] [627|MainThread|alembic.runtime.migration] [INFO] Will assume non-transactional DDL.
[2020-11-12 17:13:32,243] [627|MainThread|alembic.runtime.migration] [INFO] Running upgrade -> b4c05e463b53, Create meltano.core base tables
[2020-11-12 17:13:32,283] [627|MainThread|alembic.runtime.migration] [INFO] Running upgrade b4c05e463b53 -> 6ef30ab7b8e5, Create meltano.api tables
[2020-11-12 17:13:32,346] [627|MainThread|alembic.runtime.migration] [INFO] Running upgrade 6ef30ab7b8e5 -> 53e97221d99f, Add run_id to Job
[2020-11-12 17:13:32,377] [627|MainThread|alembic.runtime.migration] [INFO] Running upgrade 53e97221d99f -> a3e2b0a4937d, add_login_audit_columns
[2020-11-12 17:13:32,395] [627|MainThread|alembic.runtime.migration] [INFO] Running upgrade a3e2b0a4937d -> 990c0665f3ce, ensure user.login_count default value
[2020-11-12 17:13:32,406] [627|MainThread|alembic.runtime.migration] [INFO] Running upgrade 990c0665f3ce -> ceb00d7ff3bd, Create the EmbedToken table[2020-11-12 17:13:32,421] [627|MainThread|alembic.runtime.migration] [INFO] Running upgrade ceb00d7ff3bd -> 23ea52e6d784, add resource type to embed
token
[2020-11-12 17:13:32,443] [627|MainThread|alembic.runtime.migration] [INFO] Running upgrade 23ea52e6d784 -> 87d9638f6ac6, Add Subscription
[2020-11-12 17:13:32,458] [627|MainThread|alembic.runtime.migration] [INFO] Running upgrade 87d9638f6ac6 -> 367228df6a43, Add 'trigger' to Job
[2020-11-12 17:13:32,470] [627|MainThread|alembic.runtime.migration] [INFO] Running upgrade 367228df6a43 -> e4fbabc3fed6, add last activity at column
Project slalom-data-platform has been created.
Next steps:
cd slalom-data-platform
Visit https://meltano.com/ to learn where to go from here
> Meltano sends anonymous usage data that helps improve the product.
> You can opt-out for new, existing, or all projects.
> https://meltano.com/docs/settings.html#send-anonymous-usage-stats
😄 )
Meltano Add Custom (Works ajsteers@D520977490:/mnt/c/Files/Source/slalom-data-platform-core/data/taps/meltano$ meltano add extractor --custom tap-dynamodb
Adding new custom extractor with name 'tap-dynamodb'...
Specify the plugin's namespace, which will serve as the:
- identifier to find related/compatible plugins
- default database schema (`load_schema` extra),
for use by loaders that support a target schema
Hit Return to accept the default: plugin name with underscores instead of dashes
(namespace) [tap_dynamodb]:
Specify the plugin's `pip install` argument, for example:
- PyPI package name:
tap-dynamodb
- Git repository URL:
git+https://gitlab.com/meltano/tap-dynamodb.git
- local directory, in editable/development mode:
-e extract/tap-dynamodb
Default: plugin name as PyPI package name
(pip_url) [tap-dynamodb]:
Specify the package's executable name
Default: package name derived from `pip_url`
(executable) [tap-dynamodb]:
Specify the tap's supported Singer features (executable flags), for example:
`catalog`: supports the `--catalog` flag
`discover`: supports the `--discover` flag
`properties`: supports the `--properties` flag
`state`: supports the `--state` flag
To find out what features a tap supports, reference its documentation or try one
of the tricks under https://meltano.com/docs/contributor-guide.html#how-to-test-a-tap.
Multiple capabilities can be separated using commas.
Default: no capabilities
(capabilities) [[]]:
Specify the tap's supported settings (`config.json` keys)
Nested properties can be represented using the `.` separator,
e.g. `auth.username` for `{ "auth": { "username": value } }`.
To find out what settings a tap supports, reference its documentation.
Multiple setting names (keys) can be separated using commas.
Default: no settings
(settings) [[]]:
Installing extractor 'tap-dynamodb'...
Installed extractor 'tap-dynamodb'