Microsoft/CNTK

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit http://cntk.ai

Kerry-Cho

@kerry-Cho

https://notebooks.azure.com/Microsoft-Learning/projects/dev290x

Gregor

@Gregor959

Hi, I understand that 2.7 is the last release.. What does that mean. As far as i understand it works in C# for both training deep neural networks and recalling from them. However the documentation and examples in C# seem incomplete. Furthermore since it is the last release no further major release will be made . Is that a correct summary of the current and final state of affairs?

delzac

@delzac

@Gregor959 Python APIs and related work are complete. C# is more patchy, but still better than anything out there (compared to other frameworks)

Gregor

@Gregor959

@delzac .. there are many deeplearning libraries ( Tensorflow, keras) using python and also more popular ones and ones that are still getting supported with future development. As far as C# and F# are concerned this was the only officially supported library on .net . The .net community has been waiting 5 years for microsoft to get the deep learning on .net . We have existing projects on .net that are screaming for deeplearning... Will the c# interface and examples be completed under 2.7 ? How is the F# looking: 100% complete as pythons's , including the documentation?

delzac

@delzac

@Gregor959 For more C# examples, you can check out https://github.com/anastasios-stamoulis/deep-learning-with-csharp-and-cntk

willprgm

@willprgm

@Gregor959 I'm also wondering about the "last main release" notice for version 2.7. Does anybody know if MS has abandoned CNTK? I've spent months developing a project using CNTK and now I feel like I should start over with a different AI toolkit. So far, I've had no luck trying to find out from MS. At this point, I think it would be a waste of time to put any time on learning any thing new for CNTK.

willprgm

@willprgm

Does anyone know anything about the fate of CNTK? Has MS abandoned it?

delzac

@delzac

@willprgm you can check out Microsoft/CNTK#3646 on the way forward

maxima120

@maxima120

I have joined to ask the same question.. @willprgm

"The CNTK 2.7 release has full support for ONNX 1.4.1, and we encourage those seeking to operationalize their CNTK models to take advantage of ONNX and the ONNX Runtime." - I fail to understand relation between CNTK future and ONNX. I thought ONNX is just model export/import format..

maxima120

@maxima120

Amazon should take over. Anyone knows Bezos phone number?

duxianghong

@duxianghong

in the future, MS will publish the CNTK 3....?

so the CNTK 2.7 is the last main release. right?

delzac

@delzac

Yes cntk2.7 will be the last main release. More details pleases check out here #3646

Basheer Radman

@Basheer94517854_twitter

Hello

Emad Barsoum

@ebarsoumMS

Yes, 2.7 is the latest release.

TchuBotin

@TchuBotin

Hi! I'm training my own data with complex objects:

python 3.5
CNTK 2.6
no GPUs
epoch=20
C.CNTK.TRAIN_E2E = True C.CNTK.E2E_MAX_EPOCHS = 20
C.NUM_ROI_PROPOSALS = 2000 C.DATA.NUM_TRAIN_IMAGES = 39
C.DATA.NUM_TEST_IMAGES = 7 C.DATA.PROPOSAL_LAYER_SCALES = [4, 8, 12]
...
So, I'm getting such outputs, is it normal or does it mea a error?
PROGRESS: 0.00%
CUDA driver version is insufficient for CUDA runtime version
CUDA driver version is insufficient for CUDA runtime version
CUDA driver version is insufficient for CUDA runtime version
CUDA driver version is insufficient for CUDA runtime version
CUDA driver version is insufficient for CUDA runtime version
CUDA driver version is insufficient for CUDA runtime version
CUDA driver version is insufficient for CUDA runtime version
CUDA driver version is insufficient for CUDA runtime version
...
Thank you for some help.

delzac

@delzac

@TchuBotin Sounds like you need to update your GPU driver

TchuBotin

@TchuBotin

Thx @delzac, but I don't have GPU only CPU:

Selected CPU as the process wide default device.
Using base model: AlexNet
lr_per_sample: [0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.0001, 0.0001, 0.0001, 0.0001, 0.0001, 0.0001, 0.0001, 0.0001, 0.0001, 0.0001, 1e-05]
Training model for 7 epochs.

Training 57513152 parameters in 27 parameter tensors.

Build info:

            Built time: Sep 14 2018 01:23:48
            Last modified date: Fri Sep 14 01:16:52 2018
            Build type: Release
            Build target: CPU-only
            With ASGD: yes
            Math lib: mkl
            Build Branch: HEAD
            Build SHA1: 7c1b0fadb64f83a41739020b24fb2d4950015229
            MPI distribution: Microsoft MPI
            MPI version: 7.0.12437.6

Perhaps, my problem is that the first time I'm trying CNTK.

Mukundh Bhushan

@MukundhBhushan

Hi guys, I created a python package a couple of days back which helps generate ML code based a yml like file called "mlm". This package as of now supports keras and a little of tf2. I would really appreciate if you guys could help out with the CNTK part as well.

This is the git hub repo: https://github.com/NebutechOpenSource/MLGen

Thank you

Michael Coen

@mhcoen

Hi all. We've been using CNTK with Cuda Toolkit v10.0 and cuDNN v7.5.1. I just tried CNTK with the latest releases of the CUDA Toolkit and cuDNN library for Cuda 10.2. CNTK works fine with these but I was expecting I might see a performance improvement during training given some of NVidia's claims. However, benchmark scores during training are unchanged. Any thoughts here? Was my expectation unreasonable? Just wondering what I'm not getting. (The testing was done on a GTX 1080. I have a newer (but smaller) Quadro T2000 in my laptop that I haven't upgraded for CUDA 10.2 yet. Any reason to expect I'd see an improvement with a different GPU?)

Many thanks.

ambarchakrabarty-DnA

@ambarchakrabarty-DnA

Hi I am looking for an AI solution that can automatically read data from excel, add conditional logic to excel data currently being added to manually to excel and then finally load data into MS Access . Can I use CNTK to deliver this solution ?

delzac

@delzac

@ambarchakrabarty-DnA No cntk is a deep learning framework and doesn't deal with excel. You might want to try PyXLL

ambarchakrabarty-DnA

@ambarchakrabarty-DnA

@delzac many thanks for getting back . Sure, I will have a look. Thanks !

JamesLear92

@JamesLear92

Hi, can someone help me understand why CNTK is not getting further releases? There is nothing else that can compete when it comes to C# development.
What should C# developers use instead? Tensorflow.Net is not as C# friendly, and won't work at all with a GTX 760

Haiping

@Oceania2018

@JamesLear92 There is a link how to use GPU for ML.NET and TF.NET: https://devblogs.microsoft.com/dotnet/announcing-ml-net-1-4-global-availability-machine-learning-for-net/

Syed Farhan Ahmad

@born-2learn

Will CNTK be participating as an org in Google Summer of Code 2020 by any chance?

Phuong Ngoc Chau

@ph0123

Can I use rpc, MPI_send, MPI_recev with CNTK? where I can find basic example distributed CPU with CNTK?

Thanks

Dhiraj K

@DhirajK32398669_twitter

Hi All

I am tying to install cntk on my windows 10 machine

by pip install cntk

but it is giving error

ERROR: Could not find a version that satisfies the requirement cntk (from versions: none)
ERROR: No matching distribution found for cntk

how to fix this

delzac

@delzac

@DhirajK32398669_twitter What version of python are you using?

Install instructions from here

https://docs.microsoft.com/en-us/cognitive-toolkit/setup-windows-python?tabs=cntkpy26

maddhatters-dev

@maddhatters-dev

@DhirajK32398669_twitter , I ran into that problem for a while, you can download it manually, more often then not you will need to run it after downloading in your sdk, many python packages are downloads that get unpacked, not auto installed for security reasons. Make sure you download the one for your operating system https://github.com/microsoft?q=cog&type=&language=

newoneincntk

@newoneincntk

Hello, any guys here?
I use PIP to install CNTK on WIN10 1909/1903. But when I run a script, although there is no error message, the training process does not start.
My PC is AMD 3950x + 2080TI.

neteraxe

@Neteraxe

Is it the support of python 3.8.3 available?

ERROR: Could not find a version that satisfies the requirement cntk (from versions: none)
ERROR: No matching distribution found for cntk

delzac

@delzac

@Neteraxe No ther's no support for python 3.8 only up to python 3.6

Иван Сердюк

@oceanfish81_twitter

Is there any interest to support Clang, for Windows builds?

I was thinking about clang-cl , for the C++ code (P/Invoke related) - and OpenCL, GPGPU code could be compiled by existing Clang (11.0 RC2)

Иван Сердюк

@oceanfish81_twitter

I have some issues here:
\Source\Math>msbuild Math.vcxproj /p:Configuration=Release /p:Platform=x64
Microsoft (R) Build Engine version 16.7.0+b89cb5fde for .NET Framework
Copyright (C) Microsoft Corporation. All rights reserved.

Build started 07.09.2020 12:50:34.
Project "C:\Users\clang\cntk_msvc\Source\Math\Math.vcxproj" on node 1 (default targets).
InitializeBuildStatus:
Touching "C:\Users\clang\cntk_msvc\x64.build\Release\Source\Math\Math.tlog\unsuccessfulbuild".
ClCompile:
All outputs are up-to-date.
C:\Program Files\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.16.27023\bin\HostX86\x64\CL.exe /c /I"C:\Pro
gram Files\Intel\mklml\include" /IC:\Users\clang\cntk_msvcSource\Common\include /I\include /Zi /nologo /W4 /WX /diagn
ostics:classic /sdl /MP /O2 /Oi /Ot /D NDEBUG /D USE_MKL /D NO_SYNC /D WIN32 /D _WINDOWS /D _USRDLL /D MATH_EXPORTS /
D _WINDLL /D _UNICODE /D UNICODE /D NDEBUG /D "CNTK_VERSION=\"2.7\"" /D "CNTK_VERSION_BANNER=\"2.7+\"" /D "CNTK_COMPO
NENT_VERSION=\"2.7\"" /D HAS_MPI=1 /Gm- /EHsc /MD /GS /Gy /Qpar /fp:fast /fp:except- /Zc:wchar_t /Zc:forScope /Zc:inl
ine /openmp /Yu"stdafx.h" /Fp"C:\Users\clang\cntk_msvc\x64.build\Release\Source\Math\Cntk.Math-2.7.pch" /Fo"C:\Users
\clang\cntk_msvc\x64.build\Release\Source\Math\" /Fd"C:\Users\clang\cntk_msvc\x64.build\Release\Source\Math\vc141.
pdb" /Gd /TP /wd4819 /FC /errorReport:queue /d2Zi+ /bigobj BatchNormalizationEngine.cpp ConvolutionEngine.cpp CPUMatr
ixDouble.cpp CPUMatrixFloat.cpp CPUMatrixHalf.cpp CPUMatrixTensorDouble.cpp CPUMatrixTensorFloat.cpp CPUMatrixTensorH
alf.cpp MatrixQuantizerCPU.cpp MatrixQuantizerImpl.cpp Matrix.cpp QuantizedMatrix.cpp
BatchNormalizationEngine.cpp
c:\users\clang\cntk_msvc\source\math\half.hpp(36): error C2371: 'half': redefinition; different basic types [C:\Users\c
lang\cntk_msvc\Source\Math\Math.vcxproj]
c:\program files\cuda-11\include\cuda_fp16.hpp(2270): note: see declaration of 'half'
ConvolutionEngine.cpp
c:\users\clang\cntk_msvc\source\math\half.hpp(36): error C2371: 'half': redefinition; different basic types [C:\Users\c
lang\cntk_msvc\Source\Math\Math.vcxproj]
c:\program files\cuda-11\include\cuda_fp16.hpp(2270): note: see declaration of 'half'
CPUMatrixDouble.cpp
c:\users\clang\cntk_msvc\source\math\half.hpp(36): error C2371: 'half': redefinition; different basic types [C:\Users\c
lang\cntk_msvc\Source\Math\Math.vcxproj]
c:\program files\cuda-11\include\cuda_fp16.hpp(2270): note: see declaration of 'half'
Unknown compiler version - please run the configure tests and report the results
CPUMatrixFloat.cpp
c:\users\clang\cntk_msvc\source\math\half.hpp(36): error C2371: 'half': redefinition; different basic types [C:\Users\c
lang\cntk_msvc\Source\Math\Math.vcxproj]
c:\program files\cuda-11\include\cuda_fp16.hpp(2270): note: see declaration of 'half'
Unknown compiler version - please run the configure tests and report the results
CPUMatrixHalf.cpp
c:\users\clang\cntk_msvc\source\math\half.hpp(36): error C2371: 'half': redefinition; different basic types [C:\Users\c
lang\cntk_msvc\Source\Math\Math.vcxproj]
c:\program files\cuda-11\include\cuda_fp16.hpp(2270): note: see declaration of 'half'
Unknown compiler version - please run the configure tests and report the results
CPUMatrixTensorDouble.cpp
c:\users\clang\cntk_msvc\source\math\half.hpp(36): error C2371: 'half': redefinition; different basic types [C:\Users\c
lang\cntk_msvc\Source\Math\Math.vcxproj]
c:\program files\cuda-11\include\cuda_fp16.hpp(2270): note: see declaration of 'half'
CPUMatrixTensorFloat.cpp
c:\users\clang\cntk_msvc\source\math\half.hpp(36): error C2371: 'half': redefinition; different basic types [C:\Users\c
lang\cntk_msvc\Source\Math\Math.vcxproj]
c:\program files\cuda-11\include\cuda_fp16.hpp(2270): note: see declaration of 'half'
CPUMatrixTensorHalf.cpp
c:\users\clang\cntk_msvc\source\math\half.hpp(36): error C2371: 'half': redefinition; different basic types [C:\Users\c
lang\cntk_msvc\Source\Math\Math.vcxproj]
c:\program files\cuda-11\include\cuda_fp16.hpp(2270): note

Richerd Namsseng

@namsseng

Hello. I have a question. I want using CUDA 11 for CNTK. Becouse I am using RTX 3090.

Dae Hyun Baik

@dh.baik_gitlab

You need to rebuild CNTK with CUDA 11. but it's not piece of cake.

Where communities thrive

People

Repo info

Activity

Training 57513152 parameters in 27 parameter tensors.