Skip to content

"parallel" multinomial logit #2

@paolo-losi

Description

@paolo-losi

Hi Fabian,

I'm working on a dense problem (n_samples=1000, n_features=32000)
for which classical formulation of ordinal logistic regression is somewhat
too constrained.

As an alternative I was considering standard multinomial logit
with the constraint that the sigmoid functions should be parallel.

This would be less restricted than ordinal logistic regression since
the "slopes" of the sigmoids would be allowed to be different
while avoiding any crossing of the curves.

The questions are:

  1. Do you thing such an optimization target loss would be useful?
    Would it be in scope with minirank? Are you aware of any
    paper related to this approach?

  2. Since manual derivation of gradient and hessian is quite heavy and
    error prone, is there any automatic differentiation framework that you
    have tested or you would suggest? Have you done any experiment
    with automatic differentiation?

  3. While being definitely out of scope for minirank. I would be nice to have
    a l2 penalized logistic package for dense/sparse problems based on
    pytron solving multinomial logit (with/without parallel constraint) and
    ordinal regression based on pytron ...

Thanks!
Paolo

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions