python/typing

PEP 484, mypy, typeshed, pytype, pyre and typing in PyCharm

altendky @altendky sighs

Kyle Altendorf

@altendky

bad repro, sorry.

i'll explore the difference between that and the actual situation. thanks.

Shantanu

@hauntsaninja

thanks for making a repro though! :-) let me know if there's something i could add to stubtest to make debugging easier

@DW07045298_twitter

Hi, can anyone help me understand what is wrong with my annotations on my code https://bpa.st/MGSOM . mypy thinks there is an error on L8 but I dont understand what is wrong. It looks like mypy correctly restricts to one type of a Union when it enters an if block but it throws that knowledge away when it enters a locally defined function (compare L5 & L7). Is this a mypy bug?

@DW07045298_twitter

from typing import Union

def foo(X: Union[int, str]) -> bool:
    if isinstance(X, str):
        reveal_type(X)  # str
        def g(y: int) -> bool:
            reveal_type(X)  # Union[int, str]
            return len(X) > y  # <<<<< error: Argument 1 to "len" has incompatible type "Union[int, str]"; expected "Sized"

        return g(10)

    reveal_type(X)  # int
    return bool(X)

Jahnavi-Jonnalagadda

@Jahnavi-Jonnalagadda

Hi There! How can we use an if statement in a for loop statement?

Anyone please

Shantanu

@hauntsaninja

@DW07045298_twitter https://github.com/python/mypy/issues/2608#issuecomment-727042292

Alex Grönholm

@agronholm

@Jahnavi-Jonnalagadda please elaborate?

Amndeep Singh Mann

@Amndeep7

Hi folks, like was stated in the documentation, I'm trying to manually go over the stub file created by stubgen so as to provide explicit types where possible instead of using Any. I'm currently running into a snag where I don't know how to deal with a NewType that I defined - what I'm trying to do results in a mypy error. Please find below a minimal reproduction of the problem. Does anyone have any advice or am I forced to leave it as Any?

# test.py
from dataclasses import dataclass
from typing import NewType

A = NewType("A", str)

@dataclass
class Test:
    a: A

# stubgen'd test.pyi
from typing import Any

A: Any

class Test:
    a: A
    def __init__(self, a: Any) -> None: ...

# trying to remove 'Any' as much as possible
from typing import Type

A: Type[str]

class Test:
    a: A # mypy error: "test.A" is not valid as a type
    def __init__(self, a: A) -> None: ... # mypy error: "test.A" is not valid as a type

Johannes Bechberger

@parttimenerd

Has anyone experiences with supervising a thesis that has a student working on mypy? I'm going to supervise a bachelors thesis starting in April that is focused on analysing the exhaustiveness of structural pattern matching in mypy (https://pp.ipd.kit.edu/thesis.php?id=323&lang=en), as a colleague of mine developed such an analysis for Haskell.

Jiri Daněk

@jiridanek

Any advice about dmypy and mypy giving different results when checking the same code?

% dmypy check -- --local-partial-types dtests/dtests.py dtests/tests
Success: no issues found in 430 source files
% mypy --local-partial-types dtests/dtests.py dtests/tests          
dtests/dtestlib/scales/AbstractIterableComparator.py:36: error: Cannot determine type of '_result'
dtests/dtestlib/scales/AbstractIterableComparator.py:39: error: Need type annotation for '_diff' (hint: "_diff: List[<type>] = ...")
dtests/dtestlib/scales/AbstractIterableComparator.py:72: error: Incompatible types in assignment (expression has type "None", variable has type "List[Any]")
dtests/dtestlib/scales/TypeStrictComparator.py:28: error: Cannot determine type of '_result'
dtests/dtestlib/scales/TypeStrictComparator.py:29: error: Cannot determine type of '_result'
dtests/dtestlib/scales/TypeStrictComparator.py:29: error: unused 'type: ignore' comment
dtests/dtestlib/scales/DictComparator.py:34: error: Incompatible types in assignment (expression has type "Dict[<nothing>, <nothing>]", variable has type "List[Any]")
dtests/dtestlib/scales/DictComparator.py:53: error: Incompatible types in assignment (expression has type "None", variable has type "List[Any]")
dtests/dtestlib/scales/DictComparator.py:33: error: unused 'type: ignore' comment
dtests/dtestlib/scales/DictComparator.py:49: error: unused 'type: ignore' comment
dtests/dtestlib/scales/RelaxedComparator.py:28: error: Cannot determine type of '_result'
dtests/dtestlib/scales/RelaxedComparator.py:29: error: Cannot determine type of '_result'
dtests/dtestlib/scales/RelaxedComparator.py:35: error: Redundant cast to "bool"
dtests/dtestlib/scales/RelaxedComparator.py:29: error: unused 'type: ignore' comment

jherman3

@jherman3

Hi, I'm running into an issue with typevars unifying into object and therefore allowing incorrect code. Example:

T = TypeVar("T")
class Field(Generic[T]):
    dtype: Type[T]
    default: T

foo = Field(int, "asdf")  # I expect this to fail, but instead it typechecks since foo is a Field[object]

I found this issue which seems similar but is closed: python/mypy#6559
Is what I'm looking for possible in mypy?

5 replies

Jon Shea

@jonshea

A coworker of mine just asked “Is there a preferred way to return a non-value (null) from a function returning floats? Type checking doesnt like None being returned when the type is float.” Have we thought about having the “Incompatible types in assignment” error message suggest using Optional when the expression type is None? I would be happy to write a PR.

Kyle Altendorf

@altendky

i'd be wondering about an exception... but NaN is the float non-value i'd think. optional returns are a bit annoying as every call site has to check for none-ness if it does anything but pass-through the value.

Adrian Freund

@freundTech

I personally wouldn't return nan as a replacement for None, as it is possible to accidentally produce a nan value.
Python is more resistant to this than other languages, as division by 0 raises an Error instead of returning inf or nan, but it's still possible to get nan for example by calculating inf - inf

Jon Shea

@jonshea

I should have clarified, but I presupposed that Optional[int] is indeed the best choice for my coworker, and is likely to be the best choice for most users who end up running into the error: Incompatible types in assignment (expression has type "None", variable has type "foo").

Tanner Stirrat

@tstirrat15

i'm using mypy and i've got an error that seems to be something to the effect of "Argument 2 to foo has incompatible type B; expected Union[A, B, C, D]"

there's a possibility that the B that I think I've given it and the B that it received aren't the same - i can check that - but is the above a known failure mode? if so, what does it indicate?

Silvio

@silviogutierrez

@tstirrat15 : why don't you reveal_type(foo) to see the full type info

Tanner Stirrat

@tstirrat15

@silviogutierrez does reveal_type work when mypy is running or when you run the code? I can't tell from the cheatsheet

nvm got it

it's mypy

Tanner Stirrat

@tstirrat15

it looks like a restatement of the B type. it's not given in the same syntax.

Daniel Eloff

@eloff

How does one install library stubs for mypy? I tried just installed boto3-stubs, but mypy still complains boto3 doesn't have any typings. How could I check if mypy is finding it or not? Details here: https://stackoverflow.com/questions/65894133/mypy-not-picking-up-installed-stubs

EXPLOSION

@A5rocks

I'm not sure -- it worked for me?
shell:

PS C:\Users\A5rocks\Documents\boto-test> python -m venv venv
...
PS C:\Users\A5rocks\Documents\boto-test> .\venv\Scripts\activate
...
(venv) PS C:\Users\A5rocks\Documents\boto-test> pip install mypy boto3-stubs boto3
...
<open editor and put my code for example.py into, well, example.py>
(venv) PS C:\Users\A5rocks\Documents\boto-test> mypy example.py
example.py:3: note: Revealed type is 'def (self: boto3.NullHandler, record: Any) -> Any'

example.py:

import boto3

reveal_type(boto3.NullHandler.emit)

(not sure if the Anys were what you were talking about...)

Vito De Tullio

@ZeeD

I have encountered a strange behavior with any(). This is a simplified example:

import typing

T = typing.TypeVar('T')

def children(_: T) -> typing.Iterable[T]: return []

def orig(node: str) -> typing.Optional[str]:
    return any(orig(child) for child in children(node))

def no_errors(node: int) -> typing.Optional[int]:
    return any(no_errors(child) for child in children(node))

this is the output of mypy:

$ mypy mypyany.py
mypyany.py:6: error: Incompatible return value type (got "bool", expected "Optional[str]")
Found 1 error in 1 file (checked 1 source file)
$

I don't get the error in the orig() function (I can "suppose" is because any() is "too dynamic" returning the first element of a sequence of anything). But, I don't get why, just changing the return annotation type (as in no_errors) the error goes away!

1 reply

Sebastian Wagner

@sebastian-philipp

hey folks, I'm a bit lost right now. anyone knows how to make a proper decorator that changes the generic return argument?, like

def my_decorator(f: Callable[..., T]) -> Callable[..., Container[T]]:...

i.e. can I properly replace the Callables such that the resulting decorated function keeps its typed arguments?

See https://stackoverflow.com/questions/65936408/typing-function-when-decorator-change-generic-return-type for a code example

2 replies

Sebastian Wagner

@sebastian-philipp

freundTech, thanks very much

dittid

@dittid:matrix.org

[m]

Hello, the new version of mypy got released and now I'm getting errors about missing imports. Something changed about configuration file I think. I have everything in setup.cfg and now suddenly it started ignoring configuration options. Can anyone point me on the right direction to fix this?

dittid

@dittid:matrix.org

[m]

https://github.com/python/mypy/issues/9944#issuecomment-766248592

This is related

dittid

@dittid:matrix.org

[m]

FYI In setup.cfg a [mypy] section needs to exist. Even if empty.

Rémy Pecqueur

@Lordshinjo

I've got a small question / problem about the inferred type with covariant generic types.
Taking Iterable as an example, AFAIU Iterable[B] is a subtype of Iterable[A] if B is a subtype of A.
However the following doesn't make sense to me:

from typing import Iterable

class Base: pass
class A(Base): pass
class B(Base): pass

reveal_type([A(), B()])  # builtins.list[snippet.Base*]

a_it: Iterable[A] = [A()]
b_it: Iterable[B] = [B()]
reveal_type([a_it, b_it])  # builtins.list[builtins.object*]

Since both Iterable[A] and Iterable[B] are subtypes of Iterable[Base], I'd expect the last result to be a list[Iterable[Base]], however mypy finds list[object].
Am I wrong in my understanding?

6 replies

Daniel Eloff

@eloff

@A5rocks thanks, I'll try to replicate it with your example

Nikita Sobolev

@sobolevn

I want to use mypy as some sort of type-suggestion engine. Like https://pyre-check.org/docs/querying-pyre

Let's say I have this code:

def some(a: int) -> int:
    b = 1
    return a + b

So, mypy query some will return Callable[[int], int]
And mypy query some.b will return int

Is there any possible solution? Including very durty ones.

luk-f-a

@luk-f-a

hi, could someone help me with an easy question? why is mypy's revealed type Any after a cast?

import numpy as np
from typing import cast, Union


def foo(x: int) -> None:
    a:Union[np.ndarray]  = cast(np.ndarray, np.zeros(1))
    reveal_type(a) #  Revealed type is 'Any'

8 replies

test555

@_xmpp_test555=40conversations.im:matrix.org

[m]

can I use mypy with vscode?

Shantanu

@hauntsaninja

yes

Henry Schreiner

@henryiii

I've noticed that this is flagged in MyPy:

            signature = inspect.signature(f)
            signature = signature.replace(parameters=params)
            f.__signature__ = signature

.../sig_tools.py:40: error: "Callable[..., Any]" has no attribute "__signature__"

From PEP 362, setting a __signature__ is clearly allowed:

Note that the Signature object is created in a lazy manner, and is not automatically cached. However, the user can manually cache a Signature by storing it in the __signature__ attribute

In fact, this is pretty much the example from that PEP for modifying a signature. Should that be an issue to raise with typeshed?

1 reply

Yang Bo

@Bryant-Yang

after updating to 0.800, when I run "mypy ." in my project root directory, there is error: ... site-packages is in the PYTHONPATH. Please change directory so it is not.

Yang Bo

@Bryant-Yang

it seems caused by taking 'venv' virtual env directory as a package to check

may be python/mypy#4675 could fix it.

Marko Ristin

@mristin

Hi! I'd like to integrate a design-by-contract library (https://github.com/Parquery/icontract) with mypy (https://github.com/python/mypy/issues/9947).

I read through https://mypy.readthedocs.io/en/stable/extending_mypy.html. is there a way how I could access the decorators of a function or class and convert them to additional assertions during the mypy analysis?

17 replies

Henry Schreiner

@henryiii

How would I write a Generic TypeVar? Basically, I’m wanting to write the following demo function (does not work, but hopefully you can see what I’m writing):

T = TypeVar(“T”, bound=Hashable)
V = TypeVar(“V”, bound=Hashable)
M = TypeVar("M", bound=Mapping)
def reverse_mapping(mydict: M[T, V]) -> M[V, T]:
    ...

But that’s wrong. I’d like to say my function takes a mapping, like OrderedDict, and it should be able to propogate that it will return a matching mapping, OrderedDict, but with the two type arguments reversed. I don’t critically need this, but it bothers me I don’t know how to write it.

1 reply

Where communities thrive

People

Repo info

Activity