how to tune hyperparameters in llm phi 2 for better recalls - SERP Analysis

https://neptune.ai/blog/hyperparameter-optimization-for-llms

https://dassum.medium.com/fine-tune-large-language-model-llm-on-a-custom-dataset-with-qlora-fb60abdeba07

https://www.analyticsvidhya.com/blog/2022/02/a-comprehensive-guide-on-hyperparameter-tuning-and-its-techniques/

https://blog.spheron.network/best-practices-for-llm-hyperparameter-tuning

https://arxiv.org/html/2408.13296v1

https://medium.com/%40tejpal.abhyuday/optimizing-language-model-fine-tuning-with-peft-qlora-integration-and-training-time-reduction-04df39dca72b

https://www.stephendiehl.com/posts/training_llms/

https://llmmodels.org/blog/10-hyperparameter-tuning-tips-for-llm-fine-tuning/

https://www.nature.com/articles/s41598-024-75599-4

https://www.researchgate.net/publication/383428454_The_Ultimate_Guide_to_Fine-Tuning_LLMs_from_Basics_to_Breakthroughs_An_Exhaustive_Review_of_Technologies_Research_Best_Practices_Applied_Research_Challenges_and_Opportunities

https://symbl.ai/developers/blog/a-guide-to-llm-hyperparameters/

https://www.sciencedirect.com/science/article/pii/S2949761224001147

https://www.youtube.com/watch?v=y-9G41zELIY

https://www.analyticsvidhya.com/blog/2020/09/alternative-hyperparameter-optimization-technique-you-need-to-know-hyperopt/

https://www.linkedin.com/posts/asimsultan_ai-machinelearning-llm-activity-7204545015476342784-KqpF

https://dev.to/ankush_mahore/mastering-llm-hyperparameter-tuning-for-optimal-performance-1gc1

https://stats.stackexchange.com/questions/629808/is-hyperparameter-tuning-for-maximized-recall-a-bad-thing

https://www.datacamp.com/tutorial/fine-tuning-phi-3-5

https://www.reddit.com/r/reinforcementlearning/comments/hbdcs1/whats_the_right_way_of_doing_hyperparameter/

https://news.ycombinator.com/item?id=40127806

https://www.microsoft.com/en-us/research/wp-content/uploads/2025/04/phi_4_reasoning.pdf

https://github.com/microsoft/Phi-3CookBook/blob/main/code/04.Finetuning/Phi-3-finetune-qlora-python.ipynb

https://aclanthology.org/2025.coling-main.506.pdf

https://en.wikipedia.org/wiki/Large_language_model

https://docs.aws.amazon.com/sagemaker/latest/dg/jumpstart-fine-tune.html

https://lup.lub.lu.se/student-papers/record/9168299/file/9168300.pdf

https://arxiv.org/html/2412.08905v1

https://predibase.com/blog/graduate-from-openai-to-open-source-12-best-practices-for-distilling-smaller

https://www.medrxiv.org/content/10.1101/2025.05.05.25326979v1.full.pdf

https://huggingface.co/blog/gemma

https://www.flow-ai.com/blog/flow-judge

https://docs.unsloth.ai/basics/magistral-how-to-run-and-fine-tune

https://www.nature.com/articles/s41598-024-68168-2

https://web.stanford.edu/class/cs224n/final-reports/256724569.pdf

https://mlsys.org/virtual/2025/session/3146

https://www.mdpi.com/2504-4990/6/1/18

https://www.researchgate.net/publication/385779259_SC-Phi2_A_Fine-Tuned_Small_Language_Model_for_StarCraft_II_Build_Order_Prediction

https://kaitchup.substack.com/p/the-weekly-kaitchup-95