Does DeepNetworkDesigner support Transformer Layers?
11 visualizaciones (últimos 30 días)
Mostrar comentarios más antiguos
I want to add Transofmrer Layers while designing the network for deep learning using MATLAB DeepNetworkDesigner, but it doesn't show me such option. How can I add Transofmer Layers to the network designed using DeepNetworkDesigner?
0 comentarios
Respuestas (2)
Matt J
el 14 de En. de 2024
If the transformer layer is a custom layer that you have created for yourself, you would import it to deepNetworkDesigner from the workspace, as explained here,
0 comentarios
David Ho
el 18 de En. de 2024
Hi Subhadip,
In R2023b, the following layers are supported in Deep Network Designer that are commonly used in transformers:
- selfAttentionLayer
- wordEmbeddingLayer (requires Text Analytics Toolbox)
- sinusoidalPositionEncodingLayer
- positionEmbeddingLayer
- embeddingConcatenationLayer
- indexing1dLayer
- patchEmbeddingLayer (requires Computer Vision Toolbox)
Best regards,
David
0 comentarios
Ver también
Categorías
Más información sobre Image Data Workflows en Help Center y File Exchange.
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!