๋ฐ˜์‘ํ˜•

๐Ÿ‘ป OS & Tools 33

Python package dependency๋ฅผ ์•Œ๋ ค์ฃผ๋Š” pipdeptree

pipdeptree๋ผ๋Š” package๋ฅผ ์ด์šฉํ•ด ์„ค์น˜๋œ ํŒŒ์ด์ฌ ํŒจํ‚ค์ง€์˜ ์˜์กด์„ฑ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ๋‹ค. ์„ค์น˜ ๋ฐฉ๋ฒ•์€ ์•„๋ž˜์™€ ๊ฐ™๋‹ค. pip install pipdeptree pipdeptree๋ฅผ ์‹คํ–‰ํ•˜๋ฉด ๋‹ค์Œ๊ณผ ๊ฐ™์ด ์„ค์น˜๋œ Python package์˜ ์˜์กด์„ฑ์„ treeํ˜•ํƒœ๋กœ ๋ณด์—ฌ์ฃผ๊ณ , ๊ฐ€์žฅ ์œ„์—๋Š” ์ถฉ๋Œ์ด ์ผ์–ด๋‚  ์ˆ˜ ์žˆ๋Š” package์˜ ๋ชฉ๋ก์„ ๋ณด์—ฌ์ค€๋‹ค. -p option์„ ์ด์šฉํ•ด ํŠน์ • package์˜ ์˜์กด์„ฑ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, -r option์„ ์ด์šฉํ•˜๋ฉด ๋ฐ˜๋Œ€๋กœ ์–ด๋–ค package๊ฐ€ ํ•ด๋‹น package์— ์˜์กดํ•˜๊ณ  ์žˆ๋Š”์ง€๋ฅผ ํ™•์ธํ•  ์ˆ˜ ์žˆ๋‹ค. package ์˜์กด์— ์ถฉ๋Œ์ด ์ผ์–ด๋‚˜๋ฉด python ์ฝ”๋“œ๋ฅผ ์‹คํ–‰ํ•  ๋•Œ ์›์ธ๋„ ์•Œ๋ ค์ฃผ์ง€ ์•Š๋Š” ์—๋Ÿฌ๊ฐ€ ๋œฐ ๋•Œ๊ฐ€ ๋งŽ์€๋ฐ.. ๐Ÿ˜ก ์œ ์šฉํ•˜๊ฒŒ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์„ ๊ฒƒ ๊ฐ™๋‹ค.

apt ๊ด€๋ จ ๋ช…๋ น์–ด ์ •๋ฆฌ

apt์™€ apt-get์˜ ์ฐจ์ด ์ถœ์ฒ˜: https://ksbgenius.github.io/linux/2021/01/13/apt-apt-get-difference.html ์š”์•ฝํ•˜์ž๋ฉด apt-get์€ ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•œ ์˜ต์…˜์˜ ์ˆ˜๊ฐ€ ๋งŽ๊ณ , apt๋Š” ๊ทธ ์ค‘ ๋งŽ์ด ์‚ฌ์šฉํ•˜๋Š” ์˜ต์…˜๋“ค๋งŒ ์ถ”์ถœํ•ด ๋ณด๋‹ค ํŽธ๋ฆฌํ•˜๊ณ  ๊ฐ„๋‹จํ•˜๊ฒŒ ๋งŒ๋“  ๋ฒ„์ „์ธ ๋“ฏ ํ•˜๋‹ค. ์„ค์น˜๋œ ํŒจํ‚ค์ง€ ๋ชฉ๋ก ํ™•์ธ ์ถœ์ฒ˜: ์ œํƒ€์œ„ํ‚ค dpkg -l apt --installed list apt๋ณด๋‹ค๋Š” dpkg๊ฐ€ ๊ฐ€๋…์„ฑ์ด ์ข‹์€ ๊ฒƒ ๊ฐ™๋‹ค. ํŒจํ‚ค์ง€ ์‚ญ์ œ ๊ด€๋ จ ๋ช…๋ น์–ด (remove, purge, autoremove) ์ถœ์ฒ˜: https://codechacha.com/ko/linux-apt-purge-vs-remove/ #remove sudo apt-get remove (package) sud..

CUDA, driver, PyTorch + Tensorflow ํ˜ธํ™˜๋˜๋Š” version ์ฐพ๊ณ  ์„ค์น˜(์—…๊ทธ๋ ˆ์ด๋“œ, ๋‹ค์šด๊ทธ๋ ˆ์ด๋“œ)ํ•˜๊ธฐ

CUDA๋ฅผ ์„ค์น˜ ์‹œ์— driver version์— ๋งž๋Š” version์„ ์„ค์น˜ํ•ด์•ผ ํ•˜๊ณ , CUDA version์— ๋งž๋Š” version์˜ PyTorch๋ฅผ ์„ค์น˜ํ•ด์•ผ ํ•œ๋‹ค. ์ฐธ๊ณ : Driver & Cuda & PyTorch version ํ™•์ธ Python์œผ๋กœ PyTorch, Python, CUDA, cudnn ๋ฒ„์ „ ํ™•์ธ PyTorch ๋ฒ„์ „ ํ™•์ธ import torch print(torch.__version__) Python ๋ฒ„์ „ ํ™•์ธ import sys print(sys.version) Python ๊ฒฝ๋กœ ํ™•์ธ import sys print(sys.executable) CUDA & Driver ๋ฒ„์ „ ํ™•์ธ 1. nvidia-smi - Drive.. bo-10000.tistory.com 1. Nvidia ๋“œ๋ผ์ด๋ฒ„ ์„ค..

nvidia-smi์™€ nvcc๋กœ ๋ณธ CUDA version์ด ๋‹ค๋ฅผ ๋•Œ

CUDA version์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ๋Š” ๋ฐฉ๋ฒ•์€ ๋‘ ๊ฐ€์ง€๊ฐ€ ์žˆ๋‹ค. ํ•˜๋‚˜๋Š” nvidia-smi๋ฅผ ์ด์šฉํ•˜๋Š” ๊ฒƒ์ด๊ณ , ํ•˜๋‚˜๋Š” nvcc๋ฅผ ์ด์šฉํ•˜๋Š” ๊ฒƒ์ด๋‹ค. ๋‘˜์˜ version์ด ๋‹ฌ๋ผ์„œ ์ฐพ์•„๋ณด๋‹ˆ, ๋‹ค์Œ๊ณผ ๊ฐ™์€ ๋‹ต์„ ์–ป์„ ์ˆ˜ ์žˆ์—ˆ๋‹ค. ์ถœ์ฒ˜ : https://stackoverflow.com/questions/53422407/different-cuda-versions-shown-by-nvcc-and-nvidia-smi CUDA๋Š” 2๊ฐœ์˜ API๋ฅผ ๊ฐ€์ง€๊ณ  ์žˆ๋Š”๋ฐ, ํ•˜๋‚˜๋Š” runtime API์ด๊ณ  ๋‹ค๋ฅธ ํ•˜๋‚˜๋Š” driver API์ด๋‹ค. ๊ฐ API๊ฐ€ ๊ฐ์ž์˜ version์„ ๊ฐ€์ง€๊ณ  ์žˆ๋‹ค. driver API๋Š” GPU driver installer์— ์˜ํ•ด ์„ค์น˜๋˜๊ณ , runtime API๋Š” CUDA toolkit installer์—..

Git ์ด์šฉ๋ฒ•๊ณผ ๋ช…๋ น์–ด

1. Git ์„ค์น˜ ๋ฐ ์„ค์ • sudo apt-get install git-core #์‚ฌ์šฉ์ž ์ •๋ณด ์ถ”๊ฐ€ (ํ˜„์žฌ ์‹œ์Šคํ…œ์˜ ๋ชจ๋“  ๋””๋ ‰ํ† ๋ฆฌ์—์„œ ํ•ด๋‹น ์ •๋ณด ์‚ฌ์šฉ) git config --global user.name "์ด๋ฆ„" git config --global user.email "์ด๋ฉ”์ผ ์ฃผ์†Œ" #๊ธฐ๋ณธ ์„ค์ • ๋ฆฌ์ŠคํŠธ ํ™•์ธ git config --list 2. Git Repository ์ƒ์„ฑ #์ƒˆ๋กœ์šด ํ”„๋กœ์ ํŠธ ์ƒ์„ฑ git init #Git ์„œ๋ฒ„์˜ ํ”„๋กœ์ ํŠธ ๋ณต์ œ git clone [REPO_URL] [LOCAL_DIR] 3. Branch ์ƒ์„ฑ๊ณผ ๊ด€๋ฆฌ ์ฐธ๊ณ : Git ๋ธŒ๋žœ์น˜ - ๋ธŒ๋žœ์น˜๋ž€ ๋ฌด์—‡์ธ๊ฐ€ Branch์˜ ์ž‘๋™๊ตฌ์กฐ Branch ๊ด€๋ จ ๋ช…๋ น์–ด branch ๋ชฉ๋ก ํ™•์ธ git branch # ๋ชฉ๋ก์— *์ด ๋ถ™์–ด ์žˆ๋Š” ๊ฒƒ์ด ํ˜„์žฌ ..

์›๊ฒฉ ์„œ๋ฒ„์— ํŒŒ์ผ ์ „์†ก(scp)

์ฐธ๊ณ  : https://harryp.tistory.com/168 usage: scp [-12346BCpqrv] [-c cipher] [-F ssh_config] [-i identity_file] [-l limit] [-o ssh_option] [-P port] [-S program] [[user@]host1:]file1 ... [[user@]host2:]file2 cp ๋ช…๋ น์–ด์™€ ์œ ์‚ฌ. ํŒŒ์ผ๊ฒฝ๋กœ ์•ž์— ์ถœ๋ฐœ์ง€/๋„์ฐฉ์ง€ ์ •๋ณด๋งŒ ๋ถ™์Œ. ์ถœ๋ฐœ์ง€/๋„์ฐฉ์ง€๊ฐ€ ๋กœ์ปฌ์ผ์‹œ ์ƒ๋žต. 1) ๋กœ์ปฌ-->์„œ๋ฒ„ scp [ํŒŒ์ผ๊ฒฝ๋กœ] [๋„์ฐฉ์ง€์ •๋ณด(id@ip)]:[ํŒŒ์ผ๊ฒฝ๋กœ] 2) ์„œ๋ฒ„-->๋กœ์ปฌ scp [์ถœ๋ฐœ์ง€์ •๋ณด(id@ip)]:[ํŒŒ์ผ๊ฒฝ๋กœ] [ํŒŒ์ผ๊ฒฝ๋กœ]

์„œ๋ฒ„์— jupyter notebook ์›๊ฒฉ ์—ฐ๊ฒฐ

์ฐธ๊ณ  1) https://hiseon.me/python/jupyter-notebook-install/ 2) https://blog.djjproject.com/m/487 3) https://eungbean.github.io/2019/03/22/jupyter-ssh/ 4) https://www.blopig.com/blog/2018/03/running-jupyter-notebook-on-a-remote-server-via-ssh/ 1)~3) ๋”ฐ๋ผํ•˜๋‹ค๊ฐ€ ๋ธŒ๋ผ์šฐ์ €์— localhost:9000์œผ๋กœ ์—ด๋ฉด ์•ˆ์—ด๋ ค์„œ 4)๋ฅผ ์ฐธ๊ณ . 1. (local)ssh ์ด์šฉํ•˜์—ฌ ์—ฐ๊ฒฐ ssh [id]@[server] 2. (server)๊ฐ€์ƒํ™˜๊ฒฝ ์ƒ์„ฑ conda create -n [name] 3. (server)๊ฐ€์ƒํ™˜๊ฒฝ ์ง„์ž… source..

build Chromium in Ubuntu

1. depot_tools ์„ค์น˜ git clone https://chromium.googlesource.com/chromium/tools/depot_tools.git export PATH="$PATH:/path/to/depot_tools" 2. ์ฝ”๋“œ ๋‹ค์šด๋กœ๋“œ, additional build dependency ์„ค์น˜, chromium-specific hooks ์„ค์น˜ mkdir chromium cd chromium fetch --nohooks chromium # ์•ฝ 1์‹œ๊ฐ„ ์†Œ์š” cd src ./build/install-build-deps.sh gclient runhooks 3. ๋นŒ๋“œ ์„ค์ • #Default gn args out/Default # ๋‹ค์Œ ๋‚ด์šฉ๋“ค์„ ์ถ”๊ฐ€ is_debug = true is_compon..

vi ๊ฐ„๋‹จํ•œ ์‚ฌ์šฉ๋ฒ•

:wq ์ €์žฅํ•˜๊ณ  ์ข…๋ฃŒ :w ์ €์žฅ :q ์ข…๋ฃŒ :q! ์ €์žฅํ•˜์ง€ ์•Š๊ณ  ์ข…๋ฃŒ a ํ˜„์žฌ ํฌ์ธํ„ฐ ๋’ค์— ์‚ฝ์ž… u ์‹คํ–‰์ทจ์†Œ ์ถ”๊ฐ€ dd ํ˜„์žฌ ์ค„ ์‚ญ์ œ yy ํ˜„์žฌ ์ค„ ๋ณต์‚ฌ p ํ˜„์žฌ ์ค„ ์•„๋ž˜์— ๋ถ™ํ˜€๋„ฃ๊ธฐ

๋ฐ˜์‘ํ˜•