Skip to content

Commit 61e14ad

Browse files
authored
chore(model): add qwen2.5-7b-nerd-uncensored-v1.7 to the gallery (mudler#4171)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent a028d97 commit 61e14ad

File tree

1 file changed

+23
-0
lines changed

1 file changed

+23
-0
lines changed

gallery/index.yaml

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1404,6 +1404,29 @@
14041404
- filename: Athene-V2-Chat-Q4_K_M.gguf
14051405
sha256: bda8b784ad55982891e5aa69b08ce4030c91a2e28ad9c4c35284d45d3c7aeb16
14061406
uri: huggingface://bartowski/Athene-V2-Chat-GGUF/Athene-V2-Chat-Q4_K_M.gguf
1407+
- !!merge <<: *qwen25
1408+
name: "qwen2.5-7b-nerd-uncensored-v1.7"
1409+
urls:
1410+
- https://huggingface.co/jeffmeloy/Qwen2.5-7B-nerd-uncensored-v1.7
1411+
- https://huggingface.co/mradermacher/Qwen2.5-7B-nerd-uncensored-v1.7-GGUF
1412+
description: |
1413+
Model created by analyzing and selecting the optimal layers from other Qwen2.5-7B models based on their dimensional utilization efficiency, measured by the Normalized Effective Rank (NER). Computed like:
1414+
Input: Weight matrix for each model layer
1415+
Compute singular values σᵢ where σᵢ ≥ 0 # σᵢ represents the importance of each dimension
1416+
Filter values above numerical threshold (>1e-12)
1417+
Sum all singular values: S = Σσᵢ # S acts as normalization factor
1418+
Create probability distribution: pᵢ = σᵢ/S # converts singular values to probabilities summing to 1
1419+
Compute Shannon entropy: H = -Σ(pᵢ * log₂(pᵢ)) # measures information content
1420+
Calculate maximum possible entropy: H_max = log₂(n)
1421+
Final NER score = H/H_max # normalizes score to [0,1] range
1422+
Results in value between 0 and 1 for each model layer
1423+
overrides:
1424+
parameters:
1425+
model: Qwen2.5-7B-nerd-uncensored-v1.7.Q4_K_M.gguf
1426+
files:
1427+
- filename: Qwen2.5-7B-nerd-uncensored-v1.7.Q4_K_M.gguf
1428+
sha256: 42cf7a96784dc8f25c61c2404620c3e6548a024caa8dff6e435d7c86400d7ab8
1429+
uri: huggingface://mradermacher/Qwen2.5-7B-nerd-uncensored-v1.7-GGUF/Qwen2.5-7B-nerd-uncensored-v1.7.Q4_K_M.gguf
14071430
- &archfunct
14081431
license: apache-2.0
14091432
tags:

0 commit comments

Comments
 (0)