HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Position-wise optimizer: A nature-inspired optimization algorithm

Valizadeh Amir

Position-wise optimizer: A nature-inspired optimization algorithm

Abstract

The human nervous system utilizes synaptic plasticity to solve optimizationproblems. Previous studies have tried to add the plasticity factor to thetraining process of artificial neural networks, but most of those modelsrequire complex external control over the network or complex novel rules. Inthis manuscript, a novel nature-inspired optimization algorithm is introducedthat imitates biological neural plasticity. Furthermore, the model is tested onthree datasets and the results are compared with gradient descent optimization.

Benchmarks

BenchmarkMethodologyMetrics
nature-inspired-optimization-algorithm-onGradient descent optimizer
training time (s): 282
nature-inspired-optimization-algorithm-onPosition-wise optimizer
training time (s): 227
nature-inspired-optimization-algorithm-on-1Position-wise optimizer
training time (s): 23
nature-inspired-optimization-algorithm-on-1Gradient descent optimizer
training time (s): 50

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Position-wise optimizer: A nature-inspired optimization algorithm | Papers | HyperAI