2023年5月31日 星期三

nfdump command quickly

 


# quickly 

https://yurisk.info/2020/09/20/nfdump-netflow-usage-examples-cookbook/


#

https://nfdump.sourceforge.net/


#

https://manpages.ubuntu.com/manpages/xenial/man1/nfdump.1.html

2023年5月26日 星期五

ubuntu install and some services

 1. https://blog.gtwang.org/linux/install-ubuntu-linux-to-usb-stick/


2. install  nfs

https://linuxhint.com/install-and-configure-nfs-server-ubuntu-22-04/

Chatgpu

 

https://www.readfog.com/a/1688165476098740224

https://arxiv.org/pdf/2104.04473.pdf


https://medium.com/@gibramraul/security-attack-on-chatgpt-step-by-step-36edb949e56d



python effective and data

 https://www.readfog.com/a/1686829807819657216


# python sqlaclemy

https://docs.sqlalchemy.org/en/20/core/engines.html

https://towardsdatascience.com/sqlalchemy-python-tutorial-79a577141a91

https://ithelp.ithome.com.tw/articles/10220446


# python regular

https://chwang12341.medium.com/%E7%B5%A6%E8%87%AA%E5%B7%B1%E7%9A%84python%E5%B0%8F%E7%AD%86%E8%A8%98-%E5%BC%B7%E5%A4%A7%E7%9A%84%E6%95%B8%E6%93%9A%E8%99%95%E7%90%86%E5%B7%A5%E5%85%B7-%E6%AD%A3%E5%89%87%E8%A1%A8%E9%81%94%E5%BC%8F-regular-expression-regex%E8%A9%B3%E7%B4%B0%E6%95%99%E5%AD%B8-a5d20341a0b2

ELK

 1. https://ithelp.ithome.com.tw/users/20103420/ironman/1046


2. https://ithelp.ithome.com.tw/articles/10186351


3. https://ithelp.ithome.com.tw/articles/10186349


4. https://github.com/deviantony/docker-elk


5. security elk

https://ithelp.ithome.com.tw/articles/10216666


6. git

https://github.com/deviantony/docker-elk/blob/main/docker-compose.yml


7. file beat

https://www.elastic.co/guide/en/beats/filebeat/current/running-on-docker.html


https://hackmd.io/@QCZ_Kvv1ScixyAPzRYDKWQ/SytK_Y9HE?type=view


8. elk license 

https://techexpert.tips/elasticsearch/elasticsearch-trial-license-installation/


9.  video

https://www.youtube.com/watch?v=DVgKDPf7hOU&ab_channel=CodingExplained


10. filebeat nginx

https://www.bmc.com/blogs/elasticsearch-filebeat-nginx/


https://linyencheng.github.io/2020/09/02/elastic-logging-quick-start/

https://ithelp.ithome.com.tw/articles/10275576


network submask cal

 https://damaha-labo.site/converter/zh-Hant/IT/CalcSubnetMask


https://www.iptp.net/zh_HK/iptp-tools/ip-calculator/


https://david50.pixnet.net/blog/post/45215556-%5B%E7%AD%86%E8%A8%98%5Dipv4-submask%E8%A8%88%E7%AE%97


http://webtest.ccivs.cyc.edu.tw/net/new1.htm


https://ithelp.ithome.com.tw/questions/10153316

pandas tutorial

 https://pandas.pydata.org/docs/getting_started/intro_tutorials/06_calculate_statistics.html


# pandas read sql tutorial

https://mariadb.com/ko/resources/blog/reporting-with-pandas-and-seals-and-pythons-oh-my/



# pandas from records

https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.from_records.html


# pands read sql

https://pandas.pydata.org/docs/reference/api/pandas.read_sql.html

https://www.geeksforgeeks.org/sqlalchemy-orm-conversion-to-pandas-dataframe/


# to pandas data

https://stackoverflow.com/questions/29525808/sqlalchemy-orm-conversion-to-pandas-dataframe



#


rabbitmq hearbear

 https://www.rabbitmq.com/heartbeats.html


https://www.cnblogs.com/royfans/p/14169134.html

python mutithread and filelock

 https://superfastpython.com/threadpool-python/


https://py-filelock.readthedocs.io/en/latest/index.html

https://bobbyhadz.com/blog/python-get-random-key-value-from-dictionary

AI -Difussion Models

 

Diffusion Models Beat GANs on Image Synthesis


https://arxiv.org/abs/2105.05233

Machine learning PCA

 http://www.cs.otago.ac.nz/cosc453/student_tutorials/principal_components.pdf


https://chih-sheng-huang821.medium.com/%E6%A9%9F%E5%99%A8-%E7%B5%B1%E8%A8%88%E5%AD%B8%E7%BF%92-%E4%B8%BB%E6%88%90%E5%88%86%E5%88%86%E6%9E%90-principle-component-analysis-pca-58229cd26e71



Machine learning Decision tree

 # 

機器學習: Ensemble learning之Bagging、Boosting和AdaBoost

https://chih-sheng-huang821.medium.com/%E6%A9%9F%E5%99%A8%E5%AD%B8%E7%BF%92-ensemble-learning%E4%B9%8Bbagging-boosting%E5%92%8Cadaboost-af031229ebc3


#

SPAM Detection with Decision Trees

https://mef-bda503.github.io/pj-sevgilit/files/SPAM.html


#

Decision Trees Concepts with Iris Dataset

https://medium.com/intuitive-machine-learning/decision-trees-concepts-with-iris-dataset-304648b961f5




#XGBoost
https://slundberg.github.io/shap/notebooks/Census%20income%20classification%20with%20XGBoost.html


# Decision tree

https://ithelp.ithome.com.tw/articles/10271143
https://sites.google.com/view/zsgititit/home/ji-qi-xue-xi/%E6%B1%BA%E7%AD%96%E6%A8%B9decision-trees

http://debussy.im.nuu.edu.tw/sjchen/MachineLearning/final/CLS_DT.pdf

https://chtseng.wordpress.com/2017/02/10/%E6%B1%BA%E7%AD%96%E6%A8%B9-decision-trees/


https://buggyprogrammer.com/random-forest-based-features-selection/

機器學習_學習筆記系列(36):隨機森林分類(Random Forest Classifier)

https://tomohiroliu22.medium.com/%E6%A9%9F%E5%99%A8%E5%AD%B8%E7%BF%92-%E5%AD%B8%E7%BF%92%E7%AD%86%E8%A8%98%E7%B3%BB%E5%88%97-36-%E9%9A%A8%E6%A9%9F%E6%A3%AE%E6%9E%97%E5%88%86%E9%A1%9E-random-forest-classifier-bd902dc107c5



https://tomohiroliu22.medium.com/%E6%A9%9F%E5%99%A8%E5%AD%B8%E7%BF%92-%E5%AD%B8%E7%BF%92%E7%AD%86%E8%A8%98%E7%B3%BB%E5%88%97-24-%E6%B1%BA%E7%AD%96%E6%A8%B9%E5%88%86%E9%A1%9E-decision-tree-classifier-f79eb277e7a1



https://medium.com/@gary1346aa/%E6%A9%9F%E6%A2%B0%E5%AD%B8%E7%BF%92-gradient-boosting-1-272e8d7b17e1

https://www.baeldung.com/cs/gradient-boosting-trees-vs-random-forests



# sci ket and online test

https://scikit-learn.org/stable/

https://onecompiler.com/python/3z7xujrzn 


資料視覺化之 Decision tree (決策樹)範例與 Machine Learning (機器學習) 概念簡單教學(入門)
https://tree.rocks/decision-tree-graphviz-contour-with-pandas-gen-train-test-dataset-for-beginner-9137b7c8416a


# 深度學習
https://tomohiroliu22.medium.com/%E6%B7%B1%E5%BA%A6%E5%AD%B8%E7%BF%92paper%E7%B3%BB%E5%88%97-01-deep-learning-38dfd9b6a9dc

good author
https://tomohiroliu22.medium.com/

# 測試衡量
https://cynthiachuang.github.io/Common-Evaluation-MetricAccuracy-Precision-Recall-F1-ROCAUC-and-PRAUC/

機器學習Lesson 20— 為什麼「梯度提升」會叫「梯度」提升呢?

https://flag-editors.medium.com/%E6%A9%9F%E5%99%A8%E5%AD%B8%E7%BF%92lesson-20-%E7%82%BA%E4%BB%80%E9%BA%BC-%E6%A2%AF%E5%BA%A6%E6%8F%90%E5%8D%87-%E6%9C%83%E5%8F%AB-%E6%A2%AF%E5%BA%A6-%E6%8F%90%E5%8D%87%E5%91%A2-48a2d4585f44


# 學習文章
http://debussy.im.nuu.edu.tw/sjchen/ML_final.html
成為機器學習的王者系列 第 1 篇
https://ithelp.ithome.com.tw/articles/10216118