English
English Indonesia Türkçe Deutsch Español Português Pусский Français Italiano Nederlands Polski العربية ไทย Tiếng Việt 繁體中文 简体中文 日本語 한국어

#knowledgedistillation search results

No results for "#knowledgedistillation"
Applsci's profile picture. Applied Sciences (ISSN 2076-3417; IF 2.5) is an international peer-reviewed #openaccess journal on all aspects of applied natural sciences by @MDPIOpenAccess.
Applied Sciences MDPI
@Applsci
Sep 3

🔥 Read our Highly Cited Paper 📚MicroBERT: Distilling MoE-Based #Knowledge from BERT into a Lighter Model 🔗mdpi.com/2076-3417/14/1… 👨‍🔬by Dashun Zheng et al. @mpu1991 #naturallanguageprocessing #knowledgedistillation

Applsci's tweet image. 🔥 Read our Highly Cited Paper 📚MicroBERT: Distilling MoE-Based #Knowledge from BERT into a Lighter Model 🔗mdpi.com/2076-3417/14/1… 👨‍🔬by Dashun Zheng et al. @mpu1991 #naturallanguageprocessing #knowledgedistillation
0
0
1
0
122
Applsci's profile picture. Applied Sciences (ISSN 2076-3417; IF 2.5) is an international peer-reviewed #openaccess journal on all aspects of applied natural sciences by @MDPIOpenAccess.
Applied Sciences MDPI
@Applsci
Aug 5

🔥 Read our Paper 📚Discriminator-Enhanced #KnowledgeDistillation Networks 🔗mdpi.com/2076-3417/13/1… 👨‍🔬by Zhenping Li et al. @CAS__Science #knowledgedistillation #reinforcementlearning

Applsci's tweet image. 🔥 Read our Paper 📚Discriminator-Enhanced #KnowledgeDistillation Networks 🔗mdpi.com/2076-3417/13/1… 👨‍🔬by Zhenping Li et al. @CAS__Science #knowledgedistillation #reinforcementlearning
0
0
0
0
32
labelyourdata's profile picture. #DataAnnotation for enterprise & growing companies: #ComputerVision & #NLP annotation, #Data classification & categorization, #DataEntry
Label Your Data
 @labelyourdata
Jul 31

📱Big model, small device?📉 Knowledge distillation helps you shrink LLMs without killing performance. Learn how teacher–student training works👉labelyourdata.com/articles/machi… #MachineLearning #LLM #KnowledgeDistillation

0
0
1
0
55
lcs2lab's profile picture. Lab. for Computational Social Systems, a group led by @Tanmoy_Chak working on #SocialComputing #GraphMining & #NLProc
LCS2 Lab
 @lcs2lab
Jul 26

📢 New #ACL2025Findings Paper 📢 Can smaller language models learn how large ones reason, or just what they conclude? Our latest paper in #ACLFindings explores the overlooked tension in #KnowledgeDistillation - generalization vs reasoning fidelity. #NLProc

lcs2lab's tweet image. 📢 New #ACL2025Findings Paper 📢 Can smaller language models learn how large ones reason, or just what they conclude? Our latest paper in #ACLFindings explores the overlooked tension in #KnowledgeDistillation - generalization vs reasoning fidelity. #NLProc
1
0
2
1
111
chilli_tech's profile picture. Tech Chilli is a one-stop solution for learning new-age technology. *Artificial Intelligence *Robotics *Metaverse *Web 3.0
Tech Chilli
 @chilli_tech
Jun 24

📚🤖 Knowledge Distillation = small AI model learning from a big one! Smarter, faster, efficient. Perfect for NLP & vision! 🚀📱 See here - techchilli.com/artificial-int… #KnowledgeDistillation #AI2025 #DeepLearning #TechChilli #ModelCompression

chilli_tech's tweet image. 📚🤖 Knowledge Distillation = small AI model learning from a big one! Smarter, faster, efficient. Perfect for NLP & vision! 🚀📱 See here - techchilli.com/artificial-int… #KnowledgeDistillation #AI2025 #DeepLearning #TechChilli #ModelCompression
0
0
1
0
11
LeaderGPU's profile picture. #LeaderGPU - GPU as a Service: https://t.co/LLFCOezuNP H200 / H100 / A100 / A6000 / 5090 / 4090 cards. Per minute/day/week or monthly billing.
LeaderGPU
@LeaderGPU
Jun 17

What Is Knowledge Distillation? Want to understand how neural networks are trained using this powerful technique with LeaderGPU®? Get all the details on our site: leadergpu.com/catalog/606-wh… #AI #NeuralNetworks #KnowledgeDistillation #GPU #DedicatedServer #Instance #GPUCloud…

LeaderGPU's tweet image. What Is Knowledge Distillation? Want to understand how neural networks are trained using this powerful technique with LeaderGPU®? Get all the details on our site: leadergpu.com/catalog/606-wh… #AI #NeuralNetworks #KnowledgeDistillation #GPU #DedicatedServer #Instance #GPUCloud…
0
0
0
0
163
TarunMathur13's profile picture. #GrowthAdvisory #CorporateStrategy #ScaleupStrategy #FoundersAdvice #Fintech #AI #Web3 #EnterpriseTech #Cybersecurity | #KelloggAlum | RT≠ Endorsement
Tarun Mathur
@TarunMathur13
May 31

AI’s strategic importance is undeniable, with #knowledgedistillation enhancing user experiences through more efficient, tailored models. However, the challenges—limited context windows, #hallucinations, and high #computational costs—require deliberate strategies to overcome.…

0
0
0
0
21
AlvaroG47358191's profile picture. Apasionado por y de y más de pero no de
Alvaro García
 @AlvaroG47358191
May 28

Esa conversación con Mr. Tavito sobre #DeepSeek y la magia de la destilación de conocimiento... de ahí nació mi tesis. Hoy, al ver mi propio modelo destilado funcionar, la lección es clara: el único límite somos nosotros mismos. ¡A seguir mejorando! 💪 #KnowledgeDistillation

AlvaroG47358191's tweet image. Esa conversación con Mr. Tavito sobre #DeepSeek y la magia de la destilación de conocimiento... de ahí nació mi tesis. Hoy, al ver mi propio modelo destilado funcionar, la lección es clara: el único límite somos nosotros mismos. ¡A seguir mejorando! 💪 #KnowledgeDistillation
1
1
6
0
197
tenupsoft's profile picture. We deliver fast, powerful, cost-effective solutions that transform your business.
Tenup Software Services
 @tenupsoft
May 27

#KnowledgeDistillation helps you train a smaller #AIModel to mimic a larger one—perfect when data is limited or devices have low resources. Use it for similar tasks with less compute. Learn more with @tenupsoft tenupsoft.com/blog/ai-model-… #AI #AITraining #EdgeAI

tenupsoft's tweet image. #KnowledgeDistillation helps you train a smaller #AIModel to mimic a larger one—perfect when data is limited or devices have low resources. Use it for similar tasks with less compute. Learn more with @tenupsoft tenupsoft.com/blog/ai-model-… #AI #AITraining #EdgeAI
1
0
1
0
32
Sensors_MDPI's profile picture. Sensors (ISSN 1424-8220; IF: 3.5) is the leading international, peer-reviewed, #OpenAccess journal on the science and technology of #sensors and applications.
Sensors MDPI
 @Sensors_MDPI
May 23

NTCE-KD: Non-Target-Class-Enhanced Knowledge Distillation mdpi.com/1424-8220/24/1… #knowledgedistillation

Sensors_MDPI's tweet image. NTCE-KD: Non-Target-Class-Enhanced Knowledge Distillation mdpi.com/1424-8220/24/1… #knowledgedistillation
0
0
2
0
86
VI_Journal_CSIG's profile picture. Official journal of China Society of Image and Graphics (CSIG). The jouarnl is published by Springer, sponsored by CSIG. E-ISSN 2731-9008.
Visual-Intelligence
 @VI_Journal_CSIG
May 20

🌟Visual Intelligence highly cited papers No. 7🌟 Check out this cross-camera self-distillation framework for unsupervised person Re-ID to alleviate the effect of camera variation. 🔗Read more: link.springer.com/article/10.100… #Unsupervisedlearning #Personreid #Knowledgedistillation

VI_Journal_CSIG's tweet card. Visual Intelligence - Existing unsupervised person re-identification (Re-ID) methods have achieved remarkable performance by adopting an alternate clustering-training manner. However, they still...
CCSD: cross-camera self-distillation for unsupervised person re-identification
Source: link.springer.com
0
0
2
0
76
Sensors_MDPI's profile picture. Sensors (ISSN 1424-8220; IF: 3.5) is the leading international, peer-reviewed, #OpenAccess journal on the science and technology of #sensors and applications.
Sensors MDPI
 @Sensors_MDPI
May 19

Enhanced Knowledge Distillation for Advanced Recognition of Chinese Herbal Medicine mdpi.com/1424-8220/24/5… #knowledgedistillation

Sensors_MDPI's tweet image. Enhanced Knowledge Distillation for Advanced Recognition of Chinese Herbal Medicine mdpi.com/1424-8220/24/5… #knowledgedistillation
0
0
1
0
59
VI_Journal_CSIG's profile picture. Official journal of China Society of Image and Graphics (CSIG). The jouarnl is published by Springer, sponsored by CSIG. E-ISSN 2731-9008.
Visual-Intelligence
 @VI_Journal_CSIG
May 16

🌟Visual Intelligence highly cited papers No. 4🌟 Check out this novel semantic-aware knowledge distillation scheme to fill in the dimension gap between intermediate features of teacher and student. 🔗Read more: link.springer.com/article/10.100… #Knowledgedistillation #Selfattention #llm

VI_Journal_CSIG's tweet card. Visual Intelligence - Knowledge distillation aims to distill knowledge from teacher networks to train student networks. Distilling intermediate features has attracted much attention in recent years...
Semantic-aware knowledge distillation with parameter-free feature uniformization
Source: link.springer.com
0
2
5
0
142
selimskii's profile picture. Small language model fine tuning made simple Founder @ distillabs
Selim Nowicki
 @selimskii
Apr 25

#Knowledgedistillation is one of the most underrated shifts in AI. It lets you take the power of large models and transfer it into smaller, specialized ones — faster, cheaper, and easier to control. It’s not just compression. It’s focus. #KnowledgeDistillation #SLMs #AI

0
0
1
0
11
techyrushabh's profile picture. Coding, Roadmap, Solutions, Projects and more...
Techy Rushabh
 @techyrushabh
Apr 16

Want your smaller language model to punch *way* above its weight? 🥊 This paper introduces DSKD, a clever way to distill knowledge from LLMs *even* if they use different vocabularies! #AI #KnowledgeDistillation

1
0
0
0
10
kanami3190's profile picture. 田辺中1年陸上部の松井香奈実です!! よろしくお願いします!!Reddio
かなみ
 @kanami3190
Apr 5

. @soon_svm #SOONISTHEREDPILL 118. soon_svm's knowledge - distillation support can transfer knowledge from a large model to a smaller one. #soon_svm #KnowledgeDistillation

0
0
0
0
3
No results for "#knowledgedistillation"
Applsci's profile picture. Applied Sciences (ISSN 2076-3417; IF 2.5) is an international peer-reviewed #openaccess journal on all aspects of applied natural sciences by @MDPIOpenAccess.
Applied Sciences MDPI
@Applsci
Sep 3

🔥 Read our Highly Cited Paper 📚MicroBERT: Distilling MoE-Based #Knowledge from BERT into a Lighter Model 🔗mdpi.com/2076-3417/14/1… 👨‍🔬by Dashun Zheng et al. @mpu1991 #naturallanguageprocessing #knowledgedistillation

Applsci's tweet image. 🔥 Read our Highly Cited Paper 📚MicroBERT: Distilling MoE-Based #Knowledge from BERT into a Lighter Model 🔗mdpi.com/2076-3417/14/1… 👨‍🔬by Dashun Zheng et al. @mpu1991 #naturallanguageprocessing #knowledgedistillation
0
0
1
0
122
capeandcode's profile picture. Building AI systems pretending I’m still in control. Senior Data Scientist @fractalai
Prashant
@capeandcode
Feb 7, 2021

Back when we used to get stuck we had our teacher who having more capability, understood the problem better and taught us the easier way to do it. Well, the same could be done in #DeepLearning too, using what is known as #KnowledgeDistillation. 🧵👇

capeandcode's tweet image. Back when we used to get stuck we had our teacher who having more capability, understood the problem better and taught us the easier way to do it. Well, the same could be done in #DeepLearning too, using what is known as #KnowledgeDistillation. 🧵👇
2
18
82
27
0
joselobenitezg's profile picture. Founder at @intuitivo_ai. understanding vision in machines
Joselo
@joselobenitezg
Sep 27, 2023

Talking about how we make the most of "knowledge distillation" to level up our labeling process using foundation models at Google for Startups YoloVision Conference @ultralytics 🧠🤖🔍 #AI #Labeling #KnowledgeDistillation #YV23 #ComputerVision

joselobenitezg's tweet image. Talking about how we make the most of "knowledge distillation" to level up our labeling process using foundation models at Google for Startups YoloVision Conference @ultralytics 🧠🤖🔍 #AI #Labeling #KnowledgeDistillation #YV23 #ComputerVision
0
3
10
0
756
Tsinghua_Uni's profile picture. Tsinghua University is a research university located in Beijing, China, established in 1911.
Tsinghua University
@Tsinghua_Uni
Jan 16, 2023

A #MachineLearning model can be compressed by #KnowledgeDistillation to be used on less powerful hardware. A method proposed a @TsinghuaSIGS team can minimize knowledge loss during the compression of pattern detector models. For more: bit.ly/3X34is0

Tsinghua_Uni's tweet image. A #MachineLearning model can be compressed by #KnowledgeDistillation to be used on less powerful hardware. A method proposed a @TsinghuaSIGS team can minimize knowledge loss during the compression of pattern detector models. For more: bit.ly/3X34is0
Tsinghua_Uni's tweet image. A #MachineLearning model can be compressed by #KnowledgeDistillation to be used on less powerful hardware. A method proposed a @TsinghuaSIGS team can minimize knowledge loss during the compression of pattern detector models. For more: bit.ly/3X34is0
Tsinghua_Uni's tweet image. A #MachineLearning model can be compressed by #KnowledgeDistillation to be used on less powerful hardware. A method proposed a @TsinghuaSIGS team can minimize knowledge loss during the compression of pattern detector models. For more: bit.ly/3X34is0
1
2
13
0
6K
Tsinghua_Uni's profile picture. Tsinghua University is a research university located in Beijing, China, established in 1911.
Tsinghua University
@Tsinghua_Uni
Oct 1, 2023

Assoc. Prof. Wang Zhi’s team from @TsinghuaSIGS won the Best Paper Award at @IEEEorg ICME 2023. Their paper focuses on collaborative data-free #KnowledgeDistillation via multi-level feature sharing, representing the latest developments in #multimedia.

Tsinghua_Uni's tweet image. Assoc. Prof. Wang Zhi’s team from @TsinghuaSIGS won the Best Paper Award at @IEEEorg ICME 2023. Their paper focuses on collaborative data-free #KnowledgeDistillation via multi-level feature sharing, representing the latest developments in #multimedia.
1
1
11
0
3K
Applsci's profile picture. Applied Sciences (ISSN 2076-3417; IF 2.5) is an international peer-reviewed #openaccess journal on all aspects of applied natural sciences by @MDPIOpenAccess.
Applied Sciences MDPI
@Applsci
Aug 5

🔥 Read our Paper 📚Discriminator-Enhanced #KnowledgeDistillation Networks 🔗mdpi.com/2076-3417/13/1… 👨‍🔬by Zhenping Li et al. @CAS__Science #knowledgedistillation #reinforcementlearning

Applsci's tweet image. 🔥 Read our Paper 📚Discriminator-Enhanced #KnowledgeDistillation Networks 🔗mdpi.com/2076-3417/13/1… 👨‍🔬by Zhenping Li et al. @CAS__Science #knowledgedistillation #reinforcementlearning
0
0
0
0
32
furongh's profile picture. Associate professor of @umdcs @umiacs @ml_umd at UMD. Researcher in #AI/#ML, AI #Alignment, #RLHF, #Trustworthy ML, #EthicalAI, AI #Democratization, AI for ALL.
Furong Huang
@furongh
Sep 24, 2024

🧠 How do you distill the power of large language models (#LLMs) into smaller, efficient models without losing their reasoning prowess? ✨ Sequence-level #KnowledgeDistillation (KD) is the key. It isn’t just about mimicking outcomes—it’s about transferring the reasoning…

furongh's tweet image. 🧠 How do you distill the power of large language models (#LLMs) into smaller, efficient models without losing their reasoning prowess? ✨ Sequence-level #KnowledgeDistillation (KD) is the key. It isn’t just about mimicking outcomes—it’s about transferring the reasoning…
1
3
12
5
2K
TsinghuaSIGS's profile picture. A scientific research and graduate education platform of Tsinghua University, located in the vibrant city of Shenzhen.
Tsinghua SIGS
 @TsinghuaSIGS
Nov 14, 2022

Researchers have proposed a general & effective #knowledgedistillation method for #objectdetection, which helps to transfer the teacher's focal and global knowledge to the student. #machinelearning More at: bit.ly/3UB2swS

TsinghuaSIGS's tweet image. Researchers have proposed a general & effective #knowledgedistillation method for #objectdetection, which helps to transfer the teacher's focal and global knowledge to the student. #machinelearning More at: bit.ly/3UB2swS
0
1
0
0
0
TheDASHLab's profile picture. #Datadriven #AI + #Security + #HCI Lab at #Sungkyunkwan University (#성균관) with Simon S. Woo (@think24menot) #SKKU
Dash Lab
 @TheDASHLab
Aug 10, 2022

Our work "Sliding Cross Entropy for Self-Knowledge Distillation" is accepted in CIKM 2022. #CV #Computervision #KnowledgeDistillation #KD #CIKM2022

TheDASHLab's tweet image. Our work "Sliding Cross Entropy for Self-Knowledge Distillation" is accepted in CIKM 2022. #CV #Computervision #KnowledgeDistillation #KD #CIKM2022
0
0
2
0
0
PPhenomics's profile picture. Plant Phenomics, indexed in: #DOAJ #EI #PMC #SCIE (#JIF 2024: 6.4) #Scopus (#CiteScore2024: 8.2) etc. #PlantPhenomics #PlantPhenotyping #openaccess
Plant Phenomics
@PPhenomics
Aug 14, 2024

We introduce a knowledge distillation method for multi-crop, multi-disease detection, creating lightweight models with high accuracy. Ideal for smart agriculture devices. #PlantDiseaseDetection #KnowledgeDistillation #SmartFarming Details: spj.science.org/doi/10.34133/p…

PPhenomics's tweet image. We introduce a knowledge distillation method for multi-crop, multi-disease detection, creating lightweight models with high accuracy. Ideal for smart agriculture devices. #PlantDiseaseDetection #KnowledgeDistillation #SmartFarming Details: spj.science.org/doi/10.34133/p…
0
2
7
2
324
annals_csis's profile picture. Online book series that publishes FedCSIS conference proceedings, thematic volumes, projects' research reports, special editions on hot CS topics, and more.
Annals of Computer Science and Information Systems
 @annals_csis
Apr 16, 2024

Investigating the effectiveness of state-of-the-art #knowledgedistillation techniques for mapping weeds with drones: “Applying Knowledge Distillation to Improve #WeedMapping With Drones” by G. Castellano, P. De Marinis, G. Vessio. ACSIS Vol. 35 p. 393–400; tinyurl.com/4kzjnn9d

annals_csis's tweet image. Investigating the effectiveness of state-of-the-art #knowledgedistillation techniques for mapping weeds with drones: “Applying Knowledge Distillation to Improve #WeedMapping With Drones” by G. Castellano, P. De Marinis, G. Vessio. ACSIS Vol. 35 p. 393–400; tinyurl.com/4kzjnn9d
1
1
1
0
40
Sensors_MDPI's profile picture. Sensors (ISSN 1424-8220; IF: 3.5) is the leading international, peer-reviewed, #OpenAccess journal on the science and technology of #sensors and applications.
Sensors MDPI
 @Sensors_MDPI
May 23

NTCE-KD: Non-Target-Class-Enhanced Knowledge Distillation mdpi.com/1424-8220/24/1… #knowledgedistillation

Sensors_MDPI's tweet image. NTCE-KD: Non-Target-Class-Enhanced Knowledge Distillation mdpi.com/1424-8220/24/1… #knowledgedistillation
0
0
2
0
86
AlvaroG47358191's profile picture. Apasionado por y de y más de pero no de
Alvaro García
 @AlvaroG47358191
May 28

Esa conversación con Mr. Tavito sobre #DeepSeek y la magia de la destilación de conocimiento... de ahí nació mi tesis. Hoy, al ver mi propio modelo destilado funcionar, la lección es clara: el único límite somos nosotros mismos. ¡A seguir mejorando! 💪 #KnowledgeDistillation

AlvaroG47358191's tweet image. Esa conversación con Mr. Tavito sobre #DeepSeek y la magia de la destilación de conocimiento... de ahí nació mi tesis. Hoy, al ver mi propio modelo destilado funcionar, la lección es clara: el único límite somos nosotros mismos. ¡A seguir mejorando! 💪 #KnowledgeDistillation
1
1
6
0
197
lcs2lab's profile picture. Lab. for Computational Social Systems, a group led by @Tanmoy_Chak working on #SocialComputing #GraphMining & #NLProc
LCS2 Lab
 @lcs2lab
Jul 26

📢 New #ACL2025Findings Paper 📢 Can smaller language models learn how large ones reason, or just what they conclude? Our latest paper in #ACLFindings explores the overlooked tension in #KnowledgeDistillation - generalization vs reasoning fidelity. #NLProc

lcs2lab's tweet image. 📢 New #ACL2025Findings Paper 📢 Can smaller language models learn how large ones reason, or just what they conclude? Our latest paper in #ACLFindings explores the overlooked tension in #KnowledgeDistillation - generalization vs reasoning fidelity. #NLProc
1
0
2
1
111

Something went wrong.


Something went wrong.


United States Trends