Skip to content
Research Article Open access CC BY 4.0

A Heuristic Fast Gradient Descent Method for Unimodal Optimization

George Anescu

Journal of Advances in Mathematics and Computer Science · pp. 1–20 · Published 28 Feb 2018

10.9734/JAMCS/2018/39798

Abstract

The known gradient descent optimization methods applied to convex functions are using the gradient's magnitude in order to adaptively determine the current step size. The paper is presenting a new heuristic fast gradient descent (HFGD) approach, which uses the change in gradient's direction in order to adaptively determine the current step size. The new approach can be applied to solve classes of unimodal functions more general than the convex functions (e.g., quasi-convex functions), or as a local optimization method in multimodal optimization. Testing conducted on a testbed of 16 test functions showed an overall much better eciency and an overall better success rate of the proposed HFGD method when compared to other three known first order gradient descent methods.

Optimization unimodal/multimodal functions convex optimization quasi-convex optimization golden ratio fibonacci sequence first-order optimization algorithms Heuristic Fast Gradient Descent (HFGD) Backtracking Line Search (BLS) Accelerated Gradient Descent (AGD) Fast Iterative Shrinkage/Thresholding Algorithm (FISTA).

Cited by 1

Iterative Configuration of Programmable Unitary Converter Based on Few-Layer Redundant Multiplane Light Conversion

Yoshitaka Taguchi, Yunzhuo Wang, Ryota Tanomura · Physical Review Applied · 2023

Article metrics

Real usage data collected on this platform.

0

Page views

0

PDF downloads

0

Outbound clicks

1

Citations

Views by country

Approximate, from request IP at view time — not citizenship or institution. Countries with fewer than 5 views are grouped as "Other".

No views recorded yet.

Traffic sources

Referring site, by host.

No traffic recorded yet.

Views and downloads exclude known bots/crawlers. Citations combines this platform's own DOI-resolved index with each external source's own reported total — see Cited by above for individually listed citing works. Last refreshed 0 seconds ago.