Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Sep 20 18:49
    pavan-kumar222 edited #799
  • Sep 20 18:48
    pavan-kumar222 opened #799
  • Sep 20 15:48
    rakshit-jain commented #777
  • Sep 19 07:31
    Imagine-DevOps starred pybuilder/pybuilder
  • Sep 17 18:14
    arcivanov commented #774
  • Sep 17 18:13
    arcivanov commented #777
  • Sep 17 07:58
    arcivanov commented #771
  • Sep 17 07:39
    hoxu commented #771
  • Sep 17 04:44
    Coveralls pybuilder/pybuilder (master) -3.7%
  • Sep 17 04:04

    arcivanov on master

    Do not register an unpopulated … Merge pull request #798 from ar… (compare)

  • Sep 17 04:04
    arcivanov closed #798
  • Sep 17 04:04
    arcivanov closed #797
  • Sep 17 04:03
    coveralls commented #798
  • Sep 17 04:00
    coveralls commented #798
  • Sep 17 03:54
    coveralls commented #798
  • Sep 17 03:51
    coveralls commented #798
  • Sep 17 03:46
    coveralls commented #798
  • Sep 17 03:45
    coveralls commented #798
  • Sep 17 03:42
    coveralls commented #798
  • Sep 17 03:36
    coveralls commented #798
Arcadiy Ivanov
@arcivanov
please escape them too
Jalaj Patidar
@JalajPatidar
sure
can you please help, I'm having trouble formatting the logs. Posting the raw logs here
Collecting pandas
Using cached pandas-1.2.4-cp37-cp37m-manylinux1_x86_64.whl (9.9 MB)
Collecting requests
Using cached requests-2.25.1-py2.py3-none-any.whl (61 kB)
Collecting tables
Using cached tables-3.6.1-cp37-cp37m-manylinux1_x86_64.whl (4.3 MB)
Collecting pytz>=2017.3
Using cached pytz-2021.1-py2.py3-none-any.whl (510 kB)
Collecting python-dateutil>=2.7.3
Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting numpy>=1.16.5
Using cached numpy-1.20.2-cp37-cp37m-manylinux2010_x86_64.whl (15.3 MB)
Collecting chardet<5,>=3.0.2
Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.4-py2.py3-none-any.whl (153 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.12.5-py2.py3-none-any.whl (147 kB)
Collecting numexpr>=2.6.2
Using cached numexpr-2.7.3-cp37-cp37m-manylinux2010_x86_64.whl (471 kB)
Collecting six>=1.5
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Installing collected packages: pytz, six, python-dateutil, numpy, pandas, chardet, idna, urllib3, certifi, requests, numexpr, tables
Successfully installed certifi-2020.12.5 chardet-4.0.0 idna-2.10 numexpr-2.7.3 numpy-1.20.2 pandas-1.2.4 python-dateutil-2.8.1 pytz-2021.1 requests-2.25.1 six-1.15.0 tables-3.6.1 urllib3-1.26.4
WARNING: You are using pip version 20.2.3; however, version 21.0.1 is available.
You should consider upgrading via the '/home/jalaj/Mx.DataScience.Pricing/target/venv/build/cpython-3.7.9.final.0/bin/python3 -m pip install --upgrade pip' command.
Collecting h5py
Downloading h5py-3.2.1-cp37-cp37m-manylinux1_x86_64.whl (4.1 MB)
Collecting cached-property; python_version < "3.8"
Using cached cached_property-1.5.2-py2.py3-none-any.whl (7.6 kB)
Requirement already satisfied: numpy>=1.14.5; python_version == "3.7" in ./target/venv/build/cpython-3.7.9.final.0/lib/python3.7/site-packages (from h5py) (1.20.2)
Installing collected packages: cached-property, h5py
Successfully installed cached-property-1.5.2 h5py-3.2.1
WARNING: You are using pip version 20.2.3; however, version 21.0.1 is available.
You should consider upgrading via the '/home/jalaj/Mx.DataScience.Pricing/target/venv/build/cpython-3.7.9.final.0/bin/python3 -m pip install --upgrade pip' command.
Collecting openpyxl
Using cached openpyxl-3.0.7-py2.py3-none-any.whl (243 kB)
Collecting xlrd
Using cached xlrd-2.0.1-py2.py3-none-any.whl (96 kB)
Collecting et-xmlfile
Using cached et_xmlfile-1.0.1.tar.gz (8.4 kB)
Building wheels for collected packages: et-xmlfile
Building wheel for et-xmlfile (setup.py): started
Building wheel for et-xmlfile (setup.py): finished with status 'done'
Created wheel for et-xmlfile: filename=et_xmlfile-1.0.1-py3-none-any.whl size=8917 sha256=68d524030c909c3500b4105742ea6578c23371ad45c8e3db326031871d3ad310
Stored in directory: /home/jalaj/.cache/pip/wheels/e2/bd/55/048b4fd505716c4c298f42ee02dffd9496bb6d212b266c7f31
Successfully built et-xmlfile
Installing collected packages: et-xmlfile, openpyxl, xlrd
Successfully installed et-xmlfile-1.0.1 openpyxl-3.0.7 xlrd-2.0.1
WARNING: You are using pip version 20.2.3; however, version 21.0.1 is available.
You should consider upgrading via the '/home/jalaj/Mx.DataScience.Pricing/target/venv/build/cpython-3.7.9.final.0/bin/python3 -m pip install --upgrade pip' command.
Arcadiy Ivanov
@arcivanov
use markdown ```
Jalaj Patidar
@JalajPatidar
yea tried that, let's try again
Collecting pandas
  Using cached pandas-1.2.4-cp37-cp37m-manylinux1_x86_64.whl (9.9 MB)
Collecting requests
  Using cached requests-2.25.1-py2.py3-none-any.whl (61 kB)
Collecting tables
  Using cached tables-3.6.1-cp37-cp37m-manylinux1_x86_64.whl (4.3 MB)
Collecting pytz>=2017.3
  Using cached pytz-2021.1-py2.py3-none-any.whl (510 kB)
Collecting python-dateutil>=2.7.3
  Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting numpy>=1.16.5
  Using cached numpy-1.20.2-cp37-cp37m-manylinux2010_x86_64.whl (15.3 MB)
Collecting chardet<5,>=3.0.2
  Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Collecting idna<3,>=2.5
  Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached urllib3-1.26.4-py2.py3-none-any.whl (153 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2020.12.5-py2.py3-none-any.whl (147 kB)
Collecting numexpr>=2.6.2
  Using cached numexpr-2.7.3-cp37-cp37m-manylinux2010_x86_64.whl (471 kB)
Collecting six>=1.5
  Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Installing collected packages: pytz, six, python-dateutil, numpy, pandas, chardet, idna, urllib3, certifi, requests, numexpr, tables
Successfully installed certifi-2020.12.5 chardet-4.0.0 idna-2.10 numexpr-2.7.3 numpy-1.20.2 pandas-1.2.4 python-dateutil-2.8.1 pytz-2021.1 requests-2.25.1 six-1.15.0 tables-3.6.1 urllib3-1.26.4
WARNING: You are using pip version 20.2.3; however, version 21.0.1 is available.
You should consider upgrading via the '/home/jalaj/Mx.DataScience.Pricing/target/venv/build/cpython-3.7.9.final.0/bin/python3 -m pip install --upgrade pip' command.
Collecting h5py
  Downloading h5py-3.2.1-cp37-cp37m-manylinux1_x86_64.whl (4.1 MB)
Collecting cached-property; python_version < "3.8"
  Using cached cached_property-1.5.2-py2.py3-none-any.whl (7.6 kB)
Requirement already satisfied: numpy>=1.14.5; python_version == "3.7" in ./target/venv/build/cpython-3.7.9.final.0/lib/python3.7/site-packages (from h5py) (1.20.2)
Installing collected packages: cached-property, h5py
Successfully installed cached-property-1.5.2 h5py-3.2.1
WARNING: You are using pip version 20.2.3; however, version 21.0.1 is available.
You should consider upgrading via the '/home/jalaj/Mx.DataScience.Pricing/target/venv/build/cpython-3.7.9.final.0/bin/python3 -m pip install --upgrade pip' command.
Collecting openpyxl
  Using cached openpyxl-3.0.7-py2.py3-none-any.whl (243 kB)
Collecting xlrd
  Using cached xlrd-2.0.1-py2.py3-none-any.whl (96 kB)
Collecting et-xmlfile
  Using cached et_xmlfile-1.0.1.tar.gz (8.4 kB)
Building wheels for collected packages: et-xmlfile
  Building wheel for et-xmlfile (setup.py): started
  Building wheel for et-xmlfile (setup.py): finished with status 'done'
  Created wheel for et-xmlfile: filename=et_xmlfile-1.0.1-py3-none-any.whl size=8917 sha256=68d524030c909c3500b4105742ea6578c23371ad45c8e3db326031871d3ad310
  Stored in directory: /home/jalaj/.cache/pip/wheels/e2/bd/55/048b4fd505716c4c298f42ee02dffd9496bb6d212b266c7f31
Successfully built et-xmlfile
Installing collected packages: et-xmlfile, openpyxl, xlrd
Successfully installed et-xmlfile-1.0.1 openpyxl-3.0.7 xlrd-2.0.1
WARNING: You are using pip version 20.2.3; however, version 21.0.1 is available.
You should consider upgrading via the '/home/jalaj/Mx.DataScience.Pricing/target/venv/build/cpython-3.7.9.final.0/bin/python3 -m pip install --upgrade pip' command.
Arcadiy Ivanov
@arcivanov
image.png
Jalaj Patidar
@JalajPatidar

from pybuilder.core import use_plugin, init

use_plugin("python.core")
use_plugin("python.unittest")
use_plugin("python.flake8")
use_plugin("python.coverage")
use_plugin("python.distutils")


name = "Mx.DataScience.Pricing"
default_task = "publish"


@init
def set_properties(project):
    project.build_depends_on("pandas")
    project.build_depends_on("requests")
    project.build_depends_on("tables")
    project.build_depends_on("h5py")
    project.build_depends_on("openpyxl")
seems like there is some issue in formatting the test reports as xml but that's just a guess
Arcadiy Ivanov
@arcivanov
what about logs?
as in build logs
Jalaj Patidar
@JalajPatidar
sorry , are you referring to these
PyBuilder version 0.12.10
Build started at 2021-04-14 23:40:43
------------------------------------------------------------
[INFO]  Building Mx.DataScience.Pricing version 1.0.dev0
[INFO]  Executing build in /home/jalaj/Mx.DataScience.Pricing
[INFO]  Going to execute task publish
[INFO]  Processing plugin packages 'coverage~=5.2' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'flake8~=3.7' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'pypandoc~=1.4' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'setuptools>=38.6.0' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'twine>=1.15.0' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'unittest-xml-reporting~=3.0.2' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'wheel>=0.34.0' to be installed with {'upgrade': True}
[INFO]  Creating target 'build' VEnv in '/home/jalaj/Mx.DataScience.Pricing/target/venv/build/cpython-3.7.9.final.0'
[INFO]  Creating target 'test' VEnv in '/home/jalaj/Mx.DataScience.Pricing/target/venv/test/cpython-3.7.9.final.0'
[INFO]  Requested coverage for tasks: pybuilder.plugins.python.unittest_plugin:run_unit_tests
[INFO]  Running unit tests
[INFO]  Executing unit tests from Python modules in /home/jalaj/Mx.DataScience.Pricing/src/unittest/python
------------------------------------------------------------
BUILD FAILED - TypeError: 'NoneType' object is not callable (xmlrunner/runner.py:66)
------------------------------------------------------------
Build finished at 2021-04-14 23:40:57
Build took 14 seconds (14375 ms)
Arcadiy Ivanov
@arcivanov
please run with -v -X
and repost
Jalaj Patidar
@JalajPatidar
ok
Arcadiy Ivanov
@arcivanov
did you post the complete build file?
Jalaj Patidar
@JalajPatidar
[DEBUG] Registered Python environment 'system': CPython version 3.7.9.final.0 on linux in ['/home/jalaj/pipeline/bin/python3']
PyBuilder version 0.12.10
Build started at 2021-04-14 23:42:48
------------------------------------------------------------
[DEBUG] Loading project module from ./build.py
[DEBUG] Setting up plugins VEnv at '/home/jalaj/Mx.DataScience.Pricing/.pybuilder/plugins/cpython-3.7.9.final.0'
[DEBUG] Registered Python environment 'pybuilder': CPython version 3.7.9.final.0 on linux in ['/home/jalaj/Mx.DataScience.Pricing/.pybuilder/plugins/cpython-3.7.9.final.0/bin/python3']
[DEBUG] Patched __import__ system to defer plugin loading
[DEBUG] Loading plugin 'python.core'
[DEBUG] Trying to load direct plugin 'python.core', module 'pybuilder.plugins.python.core_plugin'
[DEBUG] Found direct plugin 'python.core', module 'pybuilder.plugins.python.core_plugin'
[DEBUG] Loading plugin 'python.unittest'
[DEBUG] Trying to load direct plugin 'python.unittest', module 'pybuilder.plugins.python.unittest_plugin'
[DEBUG] Found direct plugin 'python.unittest', module 'pybuilder.plugins.python.unittest_plugin'
[DEBUG] Loading plugin 'python.flake8'
[DEBUG] Trying to load direct plugin 'python.flake8', module 'pybuilder.plugins.python.flake8_plugin'
[DEBUG] Found direct plugin 'python.flake8', module 'pybuilder.plugins.python.flake8_plugin'
[DEBUG] Loading plugin 'python.coverage'
[DEBUG] Trying to load direct plugin 'python.coverage', module 'pybuilder.plugins.python.coverage_plugin'
[DEBUG] Found direct plugin 'python.coverage', module 'pybuilder.plugins.python.coverage_plugin'
[DEBUG] Loading plugin 'python.distutils'
[DEBUG] Trying to load direct plugin 'python.distutils', module 'pybuilder.plugins.python.distutils_plugin'
[DEBUG] Found direct plugin 'python.distutils', module 'pybuilder.plugins.python.distutils_plugin'
[DEBUG] Loading plugin 'core'
[DEBUG] Trying to load direct plugin 'core', module 'pybuilder.plugins.core_plugin'
[DEBUG] Found direct plugin 'core', module 'pybuilder.plugins.core_plugin'
[DEBUG] Loading plugin 'analysis'
[DEBUG] Trying to load direct plugin 'analysis', module 'pybuilder.plugins.analysis_plugin'
[DEBUG] Found direct plugin 'analysis', module 'pybuilder.plugins.analysis_plugin'
[DEBUG] Found task 'clean' with dependencies []
[DEBUG] Registering task 'clean'
[DEBUG] Found task 'compile_sources' with dependencies [prepare]
[DEBUG] Registering task 'compile_sources'
[DEBUG] Registering initializer 'init'
[DEBUG] Found task 'install' with dependencies [package, publish(optional)]
[DEBUG] Registering task 'install'
[DEBUG] Found task 'package' with dependencies [compile_sources, run_unit_tests(optional)]
[DEBUG] Registering task 'package'
[DEBUG] Found task 'prepare' with dependencies []
[DEBUG] Registering task 'prepare'
[DEBUG] Found task 'print_module_path' with dependencies []
[DEBUG] Registering task 'print_module_path'
[DEBUG] Found task 'print_scripts_path' with dependencies []
[DEBUG] Registering task 'print_scripts_path'
[DEBUG] Found task 'publish' with dependencies [package, verify(optional)]
[DEBUG] Registering task 'publish'
[DEBUG] Found task 'run_integration_tests' with dependencies [package]
[DEBUG] Registering task 'run_integration_tests'
[DEBUG] Found task 'run_unit_tests' with dependencies [compile_sources]
[DEBUG] Registering task 'run_unit_tests'
[DEBUG] Found task 'verify' with dependencies [run_integration_tests(optional)]
[DEBUG] Registering task 'verify'
[DEBUG] Found task 'prepare' with dependencies []
[DEBUG] Registering task 'prepare'
[DEBUG] Registering initializer 'init_python_directories'
[DEBUG] Found task 'package' with dependencies []
[DEBUG] Registering task 'package'
[DEBUG] Found action coverage_init
[DEBUG] Registering action 'coverage_init'
[DEBUG] Registering initializer 'init_test_source_directory'
[DEBUG] Found task 'run_unit_tests' with dependencies []
[DEBUG] Registering task 'run_unit_tests'
[DEBUG] Found task 'analyze' with dependencies [prepare]
[DEBUG] Registering task 'analyze'
[DEBUG] Found action assert_flake8_is_executable
[DEBUG] Regist
the logs posted above are from the build using the build.py file I posted above
Arcadiy Ivanov
@arcivanov
they got cut
Jalaj Patidar
@JalajPatidar
ah yeah sec
how do I post the entire thing
Arcadiy Ivanov
@arcivanov
just keep posting from the place it was cut
or post the file
Jalaj Patidar
@JalajPatidar
ok
Arcadiy Ivanov
@arcivanov
do you actually have tests there?
do me a favor
please run with pyb -Premote_debug=True -v -X
there is going to be TONS of logs
Jalaj Patidar
@JalajPatidar
I do have two tests
the build was running successfully, the modules they were testing have been unaltered since the last successful build
and I'll post the TON of logs shortly, gimme a sec
Arcadiy Ivanov
@arcivanov
thanks
:)
so if everything ran, then what changed?
Traceback (most recent call last):
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/cli.py", line 476, in main
    environments=options.environments, tasks=arguments)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/reactor.py", line 240, in build
    execution_summary = self.build_execution_plan(tasks, execution_plan)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/reactor.py", line 279, in build_execution_plan
    reactor=self)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/execution.py", line 399, in execute_execution_plan
    summaries.append(self.execute_task(task, **kwargs))
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/execution.py", line 346, in execute_task
    task.execute(self.logger, kwargs, _executable=_executable)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/execution.py", line 185, in execute
    executable.execute(argument_dict)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/execution.py", line 101, in execute
    self.callable(*arguments)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/plugins/python/unittest_plugin.py", line 71, in run_unit_tests
    run_tests(project, logger, reactor, "unittest", "unit tests")
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/plugins/python/unittest_plugin.py", line 100, in run_tests
    project.get_property("remote_debug"))
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/plugins/python/unittest_plugin.py", line 151, in execute_tests_matching
    result = runner.run(tests)
  File "/home/jalaj/Mx.DataScience.Pricing/.pybuilder/plugins/cpython-3.7.9.final.0/lib/python3.7/site-packages/xmlrunner/runner.py", line 66, in run
    test(result)
this makes little sense
Jalaj Patidar
@JalajPatidar
just added two new functions to the src/main/python/downloders.py file
Arcadiy Ivanov
@arcivanov
the test in question is null?
Jalaj Patidar
@JalajPatidar
yeah looks confusing, let me post the full logs file
Arcadiy Ivanov
@arcivanov
thanks!
Jalaj Patidar
@JalajPatidar
the two test cases that were there earlier when the build was running successfully are un-altered.
let me comment out the new code added in the main/python folder and see what happens
Arcadiy Ivanov
@arcivanov
sorry, I messed up with the logs :)
it's pyb -Premote_debug=2 -v -X
Jalaj Patidar
@JalajPatidar
no worries. I actually commented out the new code and the build passed. But it's still confusing as no new test cases were added after adding the new code.
Arcadiy Ivanov
@arcivanov
yeah, but new test cases might be failing in unexpected ways or more likely the modules fail to load
with those new methods