fades
fades copied to clipboard
PyAr
Cannot install package using fades, while installation via pip works correctly
Runing on macOS 10.15, trying the following fails:
$ fades -d pulsar-client==2.6.1
*** fades *** 2020-10-13 16:14:45,117 INFO Hi! This is fades 9.0, automatically managing your dependencies
*** fades *** 2020-10-13 16:14:45,117 INFO Checking the availabilty of dependencies in PyPI. You can use '--no-precheck-availability' to avoid it.
*** fades *** 2020-10-13 16:14:47,767 INFO Installing dependency: 'pulsar-client==2.6.1'
*** fades *** 2020-10-13 16:14:49,338 ERROR Execution ended in 1 for cmd ['/Users/user/.fades/d052cc55-a600-4dc8-8cc1-c5e8e0a9935c/bin/pip', 'install', 'pulsar-client==2.6.1']
*** fades *** 2020-10-13 16:14:49,338 ERROR :: ERROR: Could not find a version that satisfies the requirement pulsar-client==2.6.1 (from versions: none)
*** fades *** 2020-10-13 16:14:49,339 ERROR :: ERROR: No matching distribution found for pulsar-client==2.6.1
While the following works as expected:
pip install pulsar-client==2.6.1
can you please execute the same command in fades but adding "-v" thanks!
Sent from ProtonMail mobile
-------- Original Message -------- On Oct 13, 2020, 15:16, Rotem Yaari wrote:
Runing on macOS 10.15, trying the following fails:
$ fades -d pulsar-client==2.6.1 *** fades *** 2020-10-13 16:14:45,117 INFO Hi! This is fades 9.0, automatically managing your dependencies *** fades *** 2020-10-13 16:14:45,117 INFO Checking the availabilty of dependencies in PyPI. You can use '--no-precheck-availability' to avoid it. *** fades *** 2020-10-13 16:14:47,767 INFO Installing dependency: 'pulsar-client==2.6.1' *** fades *** 2020-10-13 16:14:49,338 ERROR Execution ended in 1 for cmd ['/Users/user/.fades/d052cc55-a600-4dc8-8cc1-c5e8e0a9935c/bin/pip', 'install', 'pulsar-client==2.6.1'] *** fades *** 2020-10-13 16:14:49,338 ERROR :: ERROR: Could not find a version that satisfies the requirement pulsar-client==2.6.1 (from versions: none) *** fades *** 2020-10-13 16:14:49,339 ERROR :: ERROR: No matching distribution found for pulsar-client==2.6.1
While the following works as expected:
pip install pulsar-client==2.6.1
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe.
Sure:
*** fades *** 2020-10-13 16:26:37,121 fades INFO Hi! This is fades 9.0, automatically managing your dependencies
*** fades *** 2020-10-13 16:26:37,120 fades DEBUG Running Python sys.version_info(major=3, minor=9, micro=0, releaselevel='final', serial=0) on 'macOS-10.15.7-x86_64-i386-64bit'
*** fades *** 2020-10-13 16:26:37,121 fades DEBUG Starting fades v. 9.0
*** fades *** 2020-10-13 16:26:37,121 fades DEBUG Arguments: Namespace(version=False, dependency=['pulsar-client==2.6.1'], requirement=None, python=None, ipython=False, system_site_packages=False, virtualenv_options=[], check_updates=False, no_precheck_availability=False, pip_options=[], python_options=[], remove=None, clean_unused_venvs=None, get_venv_dir=False, autoimport=False, freeze=None, verbose=True, quiet=False, executable=False, module=False, child_program=None, child_options=[])
*** fades *** 2020-10-13 16:26:37,122 fades.helpers DEBUG Using last resort base dir: ~/.fades
*** fades *** 2020-10-13 16:26:37,122 fades.cache DEBUG Using cache index: '/Users/user/.fades/venvs.idx'
*** fades *** 2020-10-13 16:26:37,122 fades.helpers DEBUG Using last resort base dir: ~/.fades
*** fades *** 2020-10-13 16:26:37,123 fades DEBUG Dependencies from parameters: {'pypi': [Requirement.parse('pulsar-client==2.6.1')]}
*** fades *** 2020-10-13 16:26:37,123 fades.helpers DEBUG Getting interpreter version for: None
*** fades *** 2020-10-13 16:26:37,123 fades.helpers DEBUG Current interpreter is /usr/local/opt/[email protected]
*** fades *** 2020-10-13 16:26:37,124 fades.cache DEBUG Searching a venv for: reqs={'pypi': {Requirement.parse('pulsar-client==2.6.1')}} interpreter=/usr/local/opt/[email protected] options={'pyvenv_options': [], 'virtualenv_options': []}
*** fades *** 2020-10-13 16:26:37,124 fades.cache DEBUG No matching venv found :(
*** fades *** 2020-10-13 16:26:37,124 fades INFO Checking the availabilty of dependencies in PyPI. You can use '--no-precheck-availability' to avoid it.
*** fades *** 2020-10-13 16:26:37,124 fades.helpers DEBUG Checking if Requirement.parse('pulsar-client==2.6.1') exists in PyPI
*** fades *** 2020-10-13 16:26:37,124 fades.helpers DEBUG Doing HEAD requests against https://pypi.org/pypi/pulsar-client/2.6.1/json
*** fades *** 2020-10-13 16:26:37,354 fades.helpers DEBUG Requirement.parse('pulsar-client==2.6.1') exists in PyPI.
*** fades *** 2020-10-13 16:26:37,357 fades.helpers DEBUG Using last resort base dir: ~/.fades
*** fades *** 2020-10-13 16:26:37,357 fades.envbuilder DEBUG Env will be created at: /Users/user/.fades/4981d0b0-8b61-42e7-bc93-29b64d2688ba
*** fades *** 2020-10-13 16:26:37,363 fades.envbuilder DEBUG Creating virtualenv with pyvenv. options=[]
*** fades *** 2020-10-13 16:26:39,948 fades.envbuilder DEBUG env_bin_path: /Users/user/.fades/4981d0b0-8b61-42e7-bc93-29b64d2688ba/bin
*** fades *** 2020-10-13 16:26:39,949 fades.helpers DEBUG Using last resort base dir: ~/.fades
*** fades *** 2020-10-13 16:26:39,949 fades.envbuilder DEBUG Installing dependencies for repo 'pypi': requested={Requirement.parse('pulsar-client==2.6.1')}
*** fades *** 2020-10-13 16:26:39,949 fades.pipmanager INFO Installing dependency: 'pulsar-client==2.6.1'
*** fades *** 2020-10-13 16:26:39,949 fades.exec DEBUG Executing external command: ['/Users/user/.fades/4981d0b0-8b61-42e7-bc93-29b64d2688ba/bin/pip', 'install', 'pulsar-client==2.6.1']
*** fades *** 2020-10-13 16:26:41,193 fades.exec DEBUG :: ERROR: Could not find a version that satisfies the requirement pulsar-client==2.6.1 (from versions: none)
*** fades *** 2020-10-13 16:26:41,193 fades.exec DEBUG :: ERROR: No matching distribution found for pulsar-client==2.6.1
*** fades *** 2020-10-13 16:26:41,714 fades.pipmanager ERROR Execution ended in 1 for cmd ['/Users/user/.fades/4981d0b0-8b61-42e7-bc93-29b64d2688ba/bin/pip', 'install', 'pulsar-client==2.6.1']
*** fades *** 2020-10-13 16:26:41,714 fades.pipmanager ERROR :: ERROR: Could not find a version that satisfies the requirement pulsar-client==2.6.1 (from versions: none)
*** fades *** 2020-10-13 16:26:41,714 fades.pipmanager ERROR :: ERROR: No matching distribution found for pulsar-client==2.6.1
*** fades *** 2020-10-13 16:26:41,715 fades.envbuilder DEBUG Installation Step failed, removing virtualenv
*** fades *** 2020-10-13 16:26:41,715 fades.envbuilder DEBUG Destroying virtualenv at: /Users/user/.fades/4981d0b0-8b61-42e7-bc93-29b64d2688ba
Hello @vmalloc ! Sorry for the late response.
That is so weird! However I've seen this kind of "pip not installing what is there" in cases of old pip.
Fades 9 should upgrade the pip in your virtualenv, before installing the dependency, but I'm not finding that in the log :(
It should appear just after the "Installing dependency" message:
*** fades *** 2020-11-15 19:42:55,236 fades.envbuilder DEBUG Installing dependencies for repo 'pypi': requested={Requirement.parse('pulsar-client==2.6.1')}
*** fades *** 2020-11-15 19:42:55,237 fades.exec DEBUG Executing external command: ['/home/facundo/.local/share/fades/7918b751-e5d6-4486-80ab-8978379441da/bin/python', '-m', 'pip', 'install', 'pip', '--upgrade']
That is, unless fades is executed with the --avoid-pip-upgrade option.
How are you executing fades?
Thanks!
Hey @facundobatista!
I'm executing plain fades, as installed from homebrew on macOS. Using the latest version (upgrading brew daily), and not passing any other options to it..
I'm failing to understand where the problem may be.
This is my whole output:
$ fades -v -d pulsar-client==2.6.1
*** fades *** 2020-11-18 22:44:54,938 fades INFO Hi! This is fades 9.0.1, automatically managing your dependencies
*** fades *** 2020-11-18 22:44:54,937 fades DEBUG Running Python sys.version_info(major=3, minor=8, micro=5, releaselevel='final', serial=0) on 'Linux-5.4.0-54-generic-x86_64-with-glibc2.29'
*** fades *** 2020-11-18 22:44:54,938 fades DEBUG Starting fades v. 9.0.1
*** fades *** 2020-11-18 22:44:54,938 fades DEBUG Arguments: Namespace(autoimport=False, avoid_pip_upgrade=False, check_updates=False, child_options=[], child_program=None, clean_unused_venvs=None, dependency=['pulsar-client==2.6.1'], executable=False, freeze=None, get_venv_dir=False, ipython=False, module=False, no_precheck_availability=False, pip_options=[], python=None, python_options=[], quiet=False, remove=None, requirement=None, system_site_packages=False, verbose=True, version=False, virtualenv_options=[])
*** fades *** 2020-11-18 22:44:54,938 fades.cache DEBUG Using cache index: '/home/facundo/.local/share/fades/venvs.idx'
*** fades *** 2020-11-18 22:44:54,939 fades DEBUG Dependencies from parameters: {'pypi': [Requirement.parse('pulsar-client==2.6.1')]}
*** fades *** 2020-11-18 22:44:54,939 fades.helpers DEBUG Getting interpreter version for: None
*** fades *** 2020-11-18 22:44:54,939 fades.helpers DEBUG Current interpreter is /usr/bin/python3.8
*** fades *** 2020-11-18 22:44:54,940 fades.cache DEBUG Searching a venv for: reqs={'pypi': {Requirement.parse('pulsar-client==2.6.1')}} interpreter=/usr/bin/python3.8 options={'pyvenv_options': [], 'virtualenv_options': []}
*** fades *** 2020-11-18 22:44:54,946 fades.cache DEBUG No matching venv found :(
*** fades *** 2020-11-18 22:44:54,946 fades INFO Checking the availabilty of dependencies in PyPI. You can use '--no-precheck-availability' to avoid it.
*** fades *** 2020-11-18 22:44:54,946 fades.helpers DEBUG Checking if Requirement.parse('pulsar-client==2.6.1') exists in PyPI
*** fades *** 2020-11-18 22:44:54,946 fades.helpers DEBUG Doing HEAD requests against https://pypi.org/pypi/pulsar-client/2.6.1/json
*** fades *** 2020-11-18 22:44:55,198 fades.helpers DEBUG Requirement.parse('pulsar-client==2.6.1') exists in PyPI.
*** fades *** 2020-11-18 22:44:55,198 fades.envbuilder DEBUG Env will be created at: /home/facundo/.local/share/fades/2229c0f3-db48-43de-bab5-30ca86292283
*** fades *** 2020-11-18 22:44:55,201 fades.envbuilder DEBUG Creating virtualenv with pyvenv. options=[]
*** fades *** 2020-11-18 22:44:56,763 fades.envbuilder DEBUG env_bin_path: /home/facundo/.local/share/fades/2229c0f3-db48-43de-bab5-30ca86292283/bin
*** fades *** 2020-11-18 22:44:56,764 fades.envbuilder DEBUG Installing dependencies for repo 'pypi': requested={Requirement.parse('pulsar-client==2.6.1')}
*** fades *** 2020-11-18 22:44:56,764 fades.exec DEBUG Executing external command: ['/home/facundo/.local/share/fades/2229c0f3-db48-43de-bab5-30ca86292283/bin/python', '-m', 'pip', 'install', 'pip', '--upgrade']
*** fades *** 2020-11-18 22:44:58,015 fades.exec DEBUG :: Collecting pip
*** fades *** 2020-11-18 22:44:58,079 fades.exec DEBUG :: Using cached pip-20.2.4-py2.py3-none-any.whl (1.5 MB)
*** fades *** 2020-11-18 22:44:58,154 fades.exec DEBUG :: Installing collected packages: pip
*** fades *** 2020-11-18 22:44:58,154 fades.exec DEBUG :: Attempting uninstall: pip
*** fades *** 2020-11-18 22:44:58,154 fades.exec DEBUG :: Found existing installation: pip 20.0.2
*** fades *** 2020-11-18 22:44:58,223 fades.exec DEBUG :: Uninstalling pip-20.0.2:
*** fades *** 2020-11-18 22:44:58,226 fades.exec DEBUG :: Successfully uninstalled pip-20.0.2
*** fades *** 2020-11-18 22:44:59,011 fades.exec DEBUG :: Successfully installed pip-20.2.4
*** fades *** 2020-11-18 22:44:59,093 fades.pipmanager INFO Installing dependency: 'pulsar-client==2.6.1'
*** fades *** 2020-11-18 22:44:59,094 fades.exec DEBUG Executing external command: ['/home/facundo/.local/share/fades/2229c0f3-db48-43de-bab5-30ca86292283/bin/pip', 'install', 'pulsar-client==2.6.1']
*** fades *** 2020-11-18 22:44:59,733 fades.exec DEBUG :: Collecting pulsar-client==2.6.1
*** fades *** 2020-11-18 22:44:59,980 fades.exec DEBUG :: Using cached pulsar_client-2.6.1-cp38-cp38-manylinux1_x86_64.whl (21.2 MB)
*** fades *** 2020-11-18 22:45:00,512 fades.exec DEBUG :: Collecting fastavro
*** fades *** 2020-11-18 22:45:01,465 fades.exec DEBUG :: Downloading fastavro-1.1.1-cp38-cp38-manylinux2014_x86_64.whl (2.4 MB)
*** fades *** 2020-11-18 22:45:01,792 fades.exec DEBUG :: Collecting six
*** fades *** 2020-11-18 22:45:01,826 fades.exec DEBUG :: Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
*** fades *** 2020-11-18 22:45:02,089 fades.exec DEBUG :: Collecting apache-bookkeeper-client>=4.9.2
*** fades *** 2020-11-18 22:45:02,327 fades.exec DEBUG :: Downloading apache_bookkeeper_client-4.12.0-py2.py3-none-any.whl (70 kB)
*** fades *** 2020-11-18 22:45:02,603 fades.exec DEBUG :: Collecting protobuf>=3.6.1
*** fades *** 2020-11-18 22:45:02,627 fades.exec DEBUG :: Using cached protobuf-3.14.0-cp38-cp38-manylinux1_x86_64.whl (1.0 MB)
*** fades *** 2020-11-18 22:45:03,301 fades.exec DEBUG :: Collecting grpcio
*** fades *** 2020-11-18 22:45:03,345 fades.exec DEBUG :: Using cached grpcio-1.33.2-cp38-cp38-manylinux2014_x86_64.whl (3.8 MB)
*** fades *** 2020-11-18 22:45:03,588 fades.exec DEBUG :: Collecting ratelimit
*** fades *** 2020-11-18 22:45:03,603 fades.exec DEBUG :: Using cached ratelimit-2.2.1.tar.gz (5.3 kB)
*** fades *** 2020-11-18 22:45:03,900 fades.exec DEBUG :: Collecting certifi
*** fades *** 2020-11-18 22:45:03,951 fades.exec DEBUG :: Using cached certifi-2020.11.8-py2.py3-none-any.whl (155 kB)
*** fades *** 2020-11-18 22:45:04,067 fades.exec DEBUG :: Collecting prometheus-client
*** fades *** 2020-11-18 22:45:04,093 fades.exec DEBUG :: Downloading prometheus_client-0.9.0-py2.py3-none-any.whl (53 kB)
*** fades *** 2020-11-18 22:45:04,380 fades.exec DEBUG :: Collecting pymmh3>=0.0.5
*** fades *** 2020-11-18 22:45:04,394 fades.exec DEBUG :: Using cached pymmh3-0.0.5-py2.py3-none-any.whl (7.4 kB)
*** fades *** 2020-11-18 22:45:04,606 fades.exec DEBUG :: Collecting pytz
*** fades *** 2020-11-18 22:45:04,648 fades.exec DEBUG :: Using cached pytz-2020.4-py2.py3-none-any.whl (509 kB)
*** fades *** 2020-11-18 22:45:04,792 fades.exec DEBUG :: Collecting requests<3.0.0dev,>=2.18.0
*** fades *** 2020-11-18 22:45:04,802 fades.exec DEBUG :: Using cached requests-2.25.0-py2.py3-none-any.whl (61 kB)
*** fades *** 2020-11-18 22:45:04,816 fades.exec DEBUG :: Requirement already satisfied: setuptools>=34.0.0 in ./.local/share/fades/2229c0f3-db48-43de-bab5-30ca86292283/lib/python3.8/site-packages (from apache-bookkeeper-client>=4.9.2->pulsar-client==2.6.1) (44.0.0)
*** fades *** 2020-11-18 22:45:04,897 fades.exec DEBUG :: Collecting chardet<4,>=3.0.2
*** fades *** 2020-11-18 22:45:04,909 fades.exec DEBUG :: Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
*** fades *** 2020-11-18 22:45:04,976 fades.exec DEBUG :: Collecting idna<3,>=2.5
*** fades *** 2020-11-18 22:45:04,990 fades.exec DEBUG :: Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
*** fades *** 2020-11-18 22:45:05,095 fades.exec DEBUG :: Collecting urllib3<1.27,>=1.21.1
*** fades *** 2020-11-18 22:45:05,108 fades.exec DEBUG :: Using cached urllib3-1.26.2-py2.py3-none-any.whl (136 kB)
*** fades *** 2020-11-18 22:45:05,122 fades.exec DEBUG :: Using legacy 'setup.py install' for ratelimit, since package 'wheel' is not installed.
*** fades *** 2020-11-18 22:45:05,162 fades.exec DEBUG :: Installing collected packages: fastavro, six, pymmh3, protobuf, grpcio, pytz, chardet, certifi, idna, urllib3, requests, apache-bookkeeper-client, ratelimit, prometheus-client, pulsar-client
*** fades *** 2020-11-18 22:45:06,671 fades.exec DEBUG :: Running setup.py install for ratelimit: started
*** fades *** 2020-11-18 22:45:06,872 fades.exec DEBUG :: Running setup.py install for ratelimit: finished with status 'done'
*** fades *** 2020-11-18 22:45:07,387 fades.exec DEBUG :: ERROR: After October 2020 you may experience errors when installing or updating packages. This is because pip will change the way that it resolves dependency conflicts.
*** fades *** 2020-11-18 22:45:07,387 fades.exec DEBUG ::
*** fades *** 2020-11-18 22:45:07,387 fades.exec DEBUG :: We recommend you use --use-feature=2020-resolver to test your packages with the new resolver before it becomes the default.
*** fades *** 2020-11-18 22:45:07,387 fades.exec DEBUG ::
*** fades *** 2020-11-18 22:45:07,387 fades.exec DEBUG :: apache-bookkeeper-client 4.12.0 requires grpcio<1.28,>=1.8.2, but you'll have grpcio 1.33.2 which is incompatible.
*** fades *** 2020-11-18 22:45:07,387 fades.exec DEBUG :: Successfully installed apache-bookkeeper-client-4.12.0 certifi-2020.11.8 chardet-3.0.4 fastavro-1.1.1 grpcio-1.33.2 idna-2.10 prometheus-client-0.9.0 protobuf-3.14.0 pulsar-client-2.6.1 pymmh3-0.0.5 pytz-2020.4 ratelimit-2.2.1 requests-2.25.0 six-1.15.0 urllib3-1.26.2
*** fades *** 2020-11-18 22:45:07,657 fades.pipmanager DEBUG getting installed version for pulsar-client
*** fades *** 2020-11-18 22:45:07,657 fades.exec DEBUG Executing external command: ['/home/facundo/.local/share/fades/2229c0f3-db48-43de-bab5-30ca86292283/bin/pip', 'show', 'pulsar-client']
*** fades *** 2020-11-18 22:45:07,811 fades.exec DEBUG :: Name: pulsar-client
*** fades *** 2020-11-18 22:45:07,812 fades.exec DEBUG :: Version: 2.6.1
*** fades *** 2020-11-18 22:45:07,812 fades.exec DEBUG :: Summary: Apache Pulsar Python client library
*** fades *** 2020-11-18 22:45:07,812 fades.exec DEBUG :: Home-page: https://pulsar.apache.org/
*** fades *** 2020-11-18 22:45:07,812 fades.exec DEBUG :: Author: Pulsar Devs
*** fades *** 2020-11-18 22:45:07,812 fades.exec DEBUG :: Author-email: [email protected]
*** fades *** 2020-11-18 22:45:07,812 fades.exec DEBUG :: License: Apache License v2.0
*** fades *** 2020-11-18 22:45:07,812 fades.exec DEBUG :: Location: /home/facundo/.local/share/fades/2229c0f3-db48-43de-bab5-30ca86292283/lib/python3.8/site-packages
*** fades *** 2020-11-18 22:45:07,813 fades.exec DEBUG :: Requires: certifi, prometheus-client, protobuf, grpcio, ratelimit, six, fastavro, apache-bookkeeper-client
*** fades *** 2020-11-18 22:45:07,813 fades.exec DEBUG :: Required-by:
*** fades *** 2020-11-18 22:45:07,828 fades.pipmanager DEBUG Installed version of pulsar-client is: 2.6.1
*** fades *** 2020-11-18 22:45:07,829 fades.envbuilder DEBUG Installed dependencies: {'pypi': {'pulsar-client': '2.6.1'}}
*** fades *** 2020-11-18 22:45:07,829 fades.cache DEBUG Storing installed={'pypi': {'pulsar-client': '2.6.1'}} metadata={'env_path': '/home/facundo/.local/share/fades/2229c0f3-db48-43de-bab5-30ca86292283', 'env_bin_path': '/home/facundo/.local/share/fades/2229c0f3-db48-43de-bab5-30ca86292283/bin', 'pip_installed': True} interpreter=/usr/bin/python3.8 options={'pyvenv_options': [], 'virtualenv_options': []}
*** fades *** 2020-11-18 22:45:07,830 fades DEBUG Calling the interactive Python interpreter: ['/home/facundo/.local/share/fades/2229c0f3-db48-43de-bab5-30ca86292283/bin/python']
Python 3.8.5 (default, Jul 28 2020, 12:59:40)
[GCC 9.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>>
As you can see, the logs differ after the "Installing dependencies" line, where in my case it goes to upgrade pip, but in yours it goes directly to install the dependency.
Me having fades 9.0.1 while you having 9.0 shouldn't make a difference, that micro version bump was for distribution purposes.
I can only think of a bad installation, or corrupted somehow. Is there a change of you removing and re-installing it?
Otherwise we could try to explore the installed code to see where the difference lives (we can do this while interacting through IRC or Telegram, if you're ok with it).
Thanks!
This got too old without followup. Closing it, feel free to reopen if problem persists.