文章

Hilbert-Mumford criterion for genus 3 curves

·

Hilbert-Mumford criterion for genus 3 curves 1 Hilbert-Mumford criterion We recall the Hilbert-Mumford criterion following [ Hoskins2023GIT ] and [ MFK1994GIT ]

Hilbert-Mumford criterion for genus 3 curves

1 Hilbert-Mumford criterion

We recall the Hilbert-Mumford criterion following [HOS23] and [MFK94].

Definition 1.1.

Let 𝐺 be a reductive group acting linearly on a projective scheme 𝑋⊆ℙ𝑛. Assume 𝑅(𝑋)=⨁𝑟≥0𝐻0(𝑋,O(𝑟)).

  1. (i)

    We say 𝑥∈𝑋 is semistable if there exists a 𝐺-invariant homogeneous function 𝑓∈𝑅(𝑋)𝐺𝑟 for some 𝑟>0 such that 𝑓(𝑥)≠0. We write 𝑋𝑠𝑠 for the open set in 𝑋 of semistable points.

  2. (ii)

    We say 𝑥∈𝑋 is stable if its orbit is closed in 𝑋𝑠𝑠 and its stabiliser is zero dimensional. We write 𝑋𝑠 for the open set in 𝑋 of stable points.

Lemma 1.2.

Let 𝐺 be a geometrically reductive group acting on an affine scheme 𝑋. If 𝑊1 and 𝑊2 are disjoint 𝐺-invariant closed subsets of 𝑋, then there is an invariant function 𝑓∈O(𝑋)𝐺 which separates these sets, i.e.

𝑓(𝑊1)=0and𝑓(𝑊2)=1.

For simplicity, we assume we have a linear representation 𝐺→𝐺𝐿(𝑉) of a reductive group 𝐺 and consider the associated linear action on 𝑋=ℙ(𝑉). For a closed subscheme 𝑌⊆𝑋 with a linear 𝐺-action, we have 𝑌𝑠𝑠=𝑌×𝑋𝑋𝑠𝑠 and so it suffices to understand semistability on the ambient projective space.

Proposition 1.3 (Topological Hilbert-Mumford criterion).

For a linear action of reductive group 𝐺 on ℙ(𝑉), the following statements hold for 𝑥=[𝑣]∈ℙ(𝑉).

  1. (a)

    𝑥 is semistable ⟺ 0∉――――𝐺⋅𝑣.

  2. (b)

    𝑥 is stable ⟺ dim⁡𝐺𝑣=0 and 𝐺⋅𝑣 is closed in 𝑉.

Proof.

We will just give the proof of the first statement. By definition 𝑥=[𝑣] is semistable ⟺ there is a 𝐺-invariant homogeneous polynomial 𝑓∈𝑅(𝑋)𝐺 which is non-zero at 𝑥. Since 𝑓 is 𝐺-invariant it is constant on orbit closures, and so 𝑓 separates the closed schemes ――――𝐺⋅𝑣 and 0, which shows these closed subschemes are disjoint. Conversely if the closed 𝐺-invariant schemes ――――𝐺⋅𝑣 and 0 in 𝑉 are disjoint, then as 𝐺 is geometrically reductive, there exists a 𝐺-invariant polynomial 𝑓∈O(𝑉)𝐺 separating these subsets

𝑓(――――𝐺⋅𝑣)=1with𝑓(0)=0

by Lemma 1.2. By considering the decomposition of 𝑓=∑𝑖𝑓𝑖 into (𝐺-invariant) homogeneous pieces, we see there is a 𝐺-invariant homogeneous piece 𝑓𝑖 which is non-vanishing at 𝑥. ∎

Definition 1.4.

For a linear action of a torus 𝑇=𝔾𝑛𝑚 on ℙ(𝑉), consider the associated weight decomposition

𝑉=⨁𝜒∈𝑋∗(𝑇)𝑉𝜒,

where 𝑋∗(𝑇):=Hom⁡(𝑇,𝔾𝑚)=Hom⁡(𝔾𝑛𝑚,𝔾𝑚)=ℤ𝑛. We refer to the support of this decomposition as the 𝑇-weights on ℙ(𝑉). For 𝑥=[𝑣]∈ℙ(𝑉), we write 𝑣=∑𝑣𝜒 and define the 𝑇-weight set of this point to be

𝑤𝑡𝑇(𝑥)=𝑤𝑡𝑇(𝑣)={𝜒∈𝑋∗(𝑇)≅ℤ𝑛:𝑣𝜒≠0}.
Definition 1.5.

If a morphism 𝑓:𝔾𝑚→𝑆, with 𝑆 separated, extends to ̃𝑓:𝔸1→𝑆, then this extension is unique and we write lim𝑡→0𝑓(𝑡):=̃𝑓(0). Similarly if 𝑓 extends to ℙ1, we write lim𝑡→∞𝑓(𝑡):=̃𝑓(∞).

Proposition 1.6 (Hilbert-Mumford for 𝔾𝑚 actions).

For a linear action of 𝔾𝑚 on ℙ(𝑉) and 𝑥∈ℙ(𝑉), the following statements hold:

  1. (a)

    𝑥 is 𝔾𝑚-semistable ⟺ 0∈𝑐𝑜𝑛𝑣(𝑤𝑡𝔾𝑚(𝑥)).

  2. (b)

    𝑥 is 𝔾𝑚-stable ⟺ 0∈𝐼𝑛𝑡(𝑐𝑜𝑛𝑣(𝑤𝑡𝔾𝑚(𝑥))).

Proof.

We again just prove the statement for semistability. By Proposition 1.3, we have that 𝑥=[𝑣]∈ℙ(𝑉) is 𝔾𝑚-semistable ⟺ 0∉――――𝔾𝑚⋅𝑣.

Since 0∉𝔾𝑚⋅𝑣, if 0∈――――𝔾𝑚⋅𝑣, then 0∈――――𝔾𝑚⋅𝑣\𝔾𝑚⋅𝑣. Any point in the boundary of this orbit closure is either

lim𝑡→0𝑡⋅𝑣orlim𝑡→∞𝑡⋅𝑣=lim𝑡→0𝑡−1⋅𝑣.

Moreover, we have lim𝑡→0𝑡⋅𝑣=0 ⟺ 𝑤𝑡𝔾𝑚(𝑣)⊆ℤ>0 and similarly lim𝑡→∞𝑡⋅𝑣=0 ⟺ 𝑤𝑡𝔾𝑚(𝑣)⊆ℤ<0. Hence 𝑥=[𝑣]∈ℙ(𝑉) is 𝔾𝑚-semistable ⟺ there exists 𝑟0∈𝑤𝑡𝔾𝑚 with 𝑟0≤0 and there exists 𝑟∞∈𝑤𝑡𝔾𝑚 with 𝑟∞≥0 , or equivalently 0∈𝑐𝑜𝑛𝑣(𝑤𝑡𝔾𝑚(𝑥)). ∎

Example 1.7.

Let 𝑋=ℙ𝑛=ℙ(𝑉), where 𝑉=𝑘𝑛+1 has basis 𝑒0,𝑒1,…,𝑒𝑛. Consider the linear action of 𝔾𝑚 on 𝑉 given by

𝑡⋅𝑒0=𝑡−1𝑒0,𝑡⋅𝑒𝑖=𝑡𝑒𝑖,𝑖=1,…,𝑛.

Equivalently, the induced action on ℙ𝑛 is

𝑡⋅[𝑥0:𝑥1:⋯:𝑥𝑛]=[𝑡−1𝑥0:𝑡𝑥1:⋯:𝑡𝑥𝑛].

Since 𝑋∗(𝔾𝑚)≅ℤ, where 𝑚∈ℤ corresponds to the character 𝑡↦𝑡𝑚, the weight decomposition of 𝑉 is

𝑉=𝑉−1⊕𝑉1,

where

𝑉−1=𝑘𝑒0,𝑉1=⟨𝑒1,…,𝑒𝑛⟩.

All other weight spaces are zero.

Let

𝑥=[𝑣]=[𝑥0:𝑥1:⋯:𝑥𝑛]∈ℙ(𝑉),

where

𝑣=𝑥0𝑒0+𝑥1𝑒1+⋯+𝑥𝑛𝑒𝑛.

With respect to the decomposition 𝑉=𝑉−1⊕𝑉1, we have

𝑣=𝑣−1+𝑣1,

where

𝑣−1=𝑥0𝑒0∈𝑉−1,𝑣1=𝑥1𝑒1+⋯+𝑥𝑛𝑒𝑛∈𝑉1.

Hence the 𝔾𝑚-weight set of 𝑥 is

wt𝔾𝑚(𝑥)={−1:𝑥0≠0}∪{1:(𝑥1,…,𝑥𝑛)≠0}.

By the Hilbert–Mumford criterion for 𝔾𝑚-actions,

𝑥∈𝑋𝑠𝑠⟺0∈conv⁡(wt𝔾𝑚(𝑥)),

and

𝑥∈𝑋𝑠⟺0∈Int⁡conv⁡(wt𝔾𝑚(𝑥)).

Therefore 𝑥 is semistable if and only if both weights −1 and 1 occur in wt𝔾𝑚(𝑥). Equivalently,

𝑥0≠0and(𝑥1,…,𝑥𝑛)≠0.

In this case

wt𝔾𝑚(𝑥)={−1,1},

and

0∈Int⁡([−1,1]).

Thus the semistable and stable loci coincide:

𝑋𝑠𝑠=𝑋𝑠={[𝑥0:⋯:𝑥𝑛]∈ℙ𝑛:𝑥0≠0, (𝑥1,…,𝑥𝑛)≠0}.

Since 𝐷+(𝑥0)≅𝔸𝑛 via

[𝑥0:𝑥1:⋯:𝑥𝑛]⟼(𝑥1𝑥0,…,𝑥𝑛𝑥0),

we get

𝑋𝑠𝑠=𝑋𝑠≅𝔸𝑛∖{0}.

Finally, the invariant section ring is

𝑅(ℙ𝑛,O(1))𝔾𝑚=𝑘[𝑥0𝑥1,…,𝑥0𝑥𝑛].

Indeed, a monomial

𝑥𝑎00𝑥𝑎11⋯𝑥𝑎𝑛𝑛

has 𝔾𝑚-weight

−𝑎0+𝑎1+⋯+𝑎𝑛,

so it is invariant if and only if

𝑎0=𝑎1+⋯+𝑎𝑛.

Hence every invariant monomial is a monomial in

𝑥0𝑥1,…,𝑥0𝑥𝑛.

Therefore

ℙ𝑛//𝔾𝑚=Proj⁡𝑘[𝑥0𝑥1,…,𝑥0𝑥𝑛]≅ℙ𝑛−1.

The quotient map on the semistable locus is

𝑋𝑠𝑠⟶ℙ𝑛−1,[𝑥0:𝑥1:⋯:𝑥𝑛]⟼[𝑥1:⋯:𝑥𝑛].

The Hilbert-Mumford criterion will ultimately be a numerical criterion that phrases semistability in terms of the weights of 1-parameter subgroups (1-PS), which are non-trivial group homomorphisms 𝜆:𝔾𝑚→𝐺.

Definition 1.8.

For a linear action of a reductive group 𝐺 on ℙ(𝑉), we define the Hilbert-Mumford weight of 𝑥=[𝑣] at a 1-parameter subgroup 𝜆:𝔾𝑚→𝐺 to be

𝜇(𝑥,𝜆):=−min𝑤𝑡𝜆(𝔾𝑚)(𝑥)=−min{𝜒∈Hom⁡(𝜆(𝔾𝑚),𝔾𝑚)≅ℤ:𝑣𝜒≠0}.
Remark 1.9.
𝜇(𝑥,𝜆−1)=−min𝑤𝑡𝜆−1(𝔾𝑚)(𝑥)=max𝑤𝑡𝜆(𝔾𝑚)(𝑥).
Proposition 1.10.
  1. (1)

    𝜇(𝑥,𝜆) is the unique integer 𝜇 such that lim𝑡→0𝑡𝜇𝜆(𝑡)⋅𝑣 exists and is non-zero.

  2. (2)

    𝜇(𝑥,𝜆)=𝜇(𝑥0,𝜆) where 𝑥0=lim𝑡→0𝜆(𝑡)⋅𝑥(and this limit exists as 𝑋 is projective).

  3. (3)

    𝜇(𝑥,𝜆)≤0⟺lim𝑡→0𝜆(𝑡)⋅𝑣 exists, with equality ⟺ lim𝑡→0𝜆(𝑡)⋅𝑣≠0.

  4. (4)

    𝜇(𝑔⋅𝑥,𝑔𝜆𝑔−1)=𝜇(𝑥,𝜆) for all 𝑔∈𝐺.

  5. (5)

    𝜇(𝑥,𝜆𝑛)=𝑛𝜇(𝑥,𝜆) for a positive integer 𝑛.

Proof.

Let 𝜆:𝔾𝑚→𝐺 be a one-parameter subgroup and let 𝑥=[𝑣]∈ℙ(𝑉). Decompose 𝑉 into 𝜆-weight spaces:

𝑉=⨁𝑟∈ℤ𝑉𝑟,𝜆(𝑡)⋅𝑤=𝑡𝑟𝑤for 𝑤∈𝑉𝑟.

Write

𝑣=∑𝑟∈ℤ𝑣𝑟,𝑣𝑟∈𝑉𝑟,

and set

wt𝜆(𝑣):={𝑟∈ℤ:𝑣𝑟≠0}.

Let

𝑟0:=minwt𝜆(𝑣).

We first prove (1). For any integer 𝜇, we have

𝑡𝜇𝜆(𝑡)⋅𝑣=∑𝑟𝑡𝜇+𝑟𝑣𝑟.

This has a limit in 𝑉 as 𝑡→0 if and only if

𝜇+𝑟≥0for all 𝑟∈wt𝜆(𝑣).

The limit is nonzero if and only if equality holds for at least one 𝑟∈wt𝜆(𝑣). Hence the unique such integer is

𝜇=−𝑟0.

Therefore

𝜇(𝑥,𝜆)=−𝑟0.

For (2), consider

𝜆(𝑡)⋅𝑥=[∑𝑟𝑡𝑟𝑣𝑟].

Multiplying the representative by 𝑡−𝑟0, we obtain

𝜆(𝑡)⋅𝑥=[∑𝑟𝑡𝑟−𝑟0𝑣𝑟].

Letting 𝑡→0, all terms with 𝑟>𝑟0 vanish, while the term 𝑣𝑟0 remains. Thus

𝑥0:=lim𝑡→0𝜆(𝑡)⋅𝑥=[𝑣𝑟0].

Since 𝑣𝑟0 has pure 𝜆-weight 𝑟0, we get

𝜇(𝑥0,𝜆)=−𝑟0=𝜇(𝑥,𝜆).

For (3), the ordinary vector limit

lim𝑡→0𝜆(𝑡)⋅𝑣=lim𝑡→0∑𝑟𝑡𝑟𝑣𝑟

exists if and only if no negative power of 𝑡 occurs, that is, if and only if

𝑟0≥0.

Since 𝜇(𝑥,𝜆)=−𝑟0, this is equivalent to

𝜇(𝑥,𝜆)≤0.

Moreover, the limit is nonzero if and only if the lowest occurring weight is 0, namely 𝑟0=0. Equivalently,

lim𝑡→0𝜆(𝑡)⋅𝑣≠0⟺𝜇(𝑥,𝜆)=0.

Thus

𝜇(𝑥,𝜆)≤0⟺lim𝑡→0𝜆(𝑡)⋅𝑣 exists,

with equality if and only if this limit is nonzero.

For (4), let 𝑔∈𝐺. Then 𝑔⋅𝑥=[𝑔⋅𝑣], and the conjugate one-parameter subgroup is

𝑔𝜆𝑔−1:𝔾𝑚→𝐺,𝑡↦𝑔𝜆(𝑡)𝑔−1.

For any integer 𝜇,

𝑡𝜇(𝑔𝜆𝑔−1)(𝑡)⋅(𝑔𝑣)=𝑔(𝑡𝜇𝜆(𝑡)⋅𝑣).

Since 𝑔:𝑉→𝑉 is a linear isomorphism, the left-hand side has a nonzero limit if and only if

𝑡𝜇𝜆(𝑡)⋅𝑣

has a nonzero limit. By the uniqueness in (1), we get

𝜇(𝑔⋅𝑥,𝑔𝜆𝑔−1)=𝜇(𝑥,𝜆).

Finally, for (5), let 𝑛 be a positive integer and define

𝜆𝑛(𝑡):=𝜆(𝑡𝑛).

If 𝑣𝑟∈𝑉𝑟 for the 𝜆-action, then

𝜆𝑛(𝑡)⋅𝑣𝑟=𝜆(𝑡𝑛)⋅𝑣𝑟=𝑡𝑛𝑟𝑣𝑟.

Thus the occurring weights for 𝜆𝑛 are

{𝑛𝑟:𝑟∈wt𝜆(𝑣)}.

Hence

𝜇(𝑥,𝜆𝑛)=−min{𝑛𝑟:𝑟∈wt𝜆(𝑣)}=−𝑛𝑟0=𝑛𝜇(𝑥,𝜆).

This proves all the assertions. ∎

For a linear 𝔾𝑚-action on ℙ(𝑉), let 𝜆(𝑡)=𝑡. Write

𝑉=⨁𝑟∈ℤ𝑉𝑟,𝑣=∑𝑟𝑣𝑟,wt𝔾𝑚(𝑣)={𝑟:𝑣𝑟≠0}.

Then

𝜇(𝑥,𝜆)=−minwt𝔾𝑚(𝑣),

whereas

𝜇(𝑥,𝜆−1)=maxwt𝔾𝑚(𝑣).

Indeed, the weights for 𝜆−1 are the negatives of the weights for 𝜆.

Thus

𝜇(𝑥,𝜆)≥0⟺minwt𝔾𝑚(𝑣)≤0,

and

𝜇(𝑥,𝜆−1)≥0⟺maxwt𝔾𝑚(𝑣)≥0.

Consequently,

0∈conv⁡(wt𝔾𝑚(𝑥))⟺𝜇(𝑥,𝜆)≥0 and 𝜇(𝑥,𝜆−1)≥0.

Similarly,

0∈Int⁡conv⁡(wt𝔾𝑚(𝑥))⟺𝜇(𝑥,𝜆)>0 and 𝜇(𝑥,𝜆−1)>0.

It is important to distinguish these numerical inequalities from the ordinary vector limit lim𝑡→0𝜆(𝑡)⋅𝑣. Since

𝜆(𝑡)⋅𝑣=∑𝑟𝑡𝑟𝑣𝑟,

this ordinary limit exists if and only if

minwt𝔾𝑚(𝑣)≥0,

or equivalently

𝜇(𝑥,𝜆)≤0.

Moreover, the limit exists and is nonzero if and only if the minimum weight is 0, that is,

lim𝑡→0𝜆(𝑡)⋅𝑣 exists and is nonzero⟺𝜇(𝑥,𝜆)=0.

Hence the condition 𝜇(𝑥,𝜆)≥0 should not be interpreted as the existence of a nonzero ordinary limit of 𝜆(𝑡)⋅𝑣; rather, it is the condition that some occurring 𝜆-weight of 𝑣 is non-positive.

Theorem 1.11 (Hilbert-Mumford criterion).

For a reductive group 𝐺 acting linearly on a projective scheme 𝑋⊆ℙ𝑛, the following statements hold for 𝑥∈𝑋.

  1. (a)

    𝑥 is semistable ⟺ 𝜇(𝑥,𝜆)≥0 for all 1-PS 𝜆:𝔾𝑚→𝐺,

  2. (b)

    𝑥 is stable ⟺ 𝜇(𝑥,𝜆)>0 for all nontrivial 1-PS 𝜆:𝔾𝑚→𝐺.

Remark 1.12.

𝜇(𝑥,𝜆)≥0 for all 1-PS 𝜆:𝔾𝑚→𝐺 ⟺ 𝜇(𝑥,𝜆)=−min𝑤𝑡𝜆(𝔾𝑚)(𝑥)≥0 and 𝜇(𝑥,𝜆−1)=max𝑤𝑡𝜆(𝔾𝑚)(𝑥)≥0 for all 1-PS 𝜆:𝔾𝑚→𝐺 ⟺ 0∈𝑐𝑜𝑛𝑣(𝑤𝑡𝜆(𝔾𝑚)(𝑥)) for all 𝜆:𝔾𝑚→𝐺.

𝜇(𝑥,𝜆)>0 for all nontrivial 1-PS 𝜆:𝔾𝑚→𝐺 ⟺ 𝜇(𝑥,𝜆)=−min𝑤𝑡𝜆(𝔾𝑚)(𝑥)>0 and 𝜇(𝑥,𝜆−1)=max𝑤𝑡𝜆(𝔾𝑚)(𝑥)>0 for all nontrivial 1-PS 𝜆:𝔾𝑚→𝐺 ⟺ 0∈𝐼𝑛𝑡(𝑐𝑜𝑛𝑣(𝑤𝑡𝜆(𝔾𝑚)(𝑥))) for all nontrivial 𝜆:𝔾𝑚→𝐺.

Remark 1.13.

Let 𝑋 be a projective 𝐺-scheme and let L be an ample 𝐺-linearised line bundle. Since L is ample, for 𝑛≫0 the line bundle L⊗𝑛 is very ample. The 𝐺-linearisation on L induces a 𝐺-linearisation on L⊗𝑛, hence a linear representation of 𝐺 on

𝐻0(𝑋,L⊗𝑛).

Thus L⊗𝑛 defines a 𝐺-equivariant closed embedding

𝑖𝑛:𝑋↪ℙ(𝐻0(𝑋,L⊗𝑛)∨),

and

L⊗𝑛≅𝑖∗𝑛O(1).

Moreover,

𝜇L⊗𝑛(𝑥,𝜆)=𝑛𝜇L(𝑥,𝜆),

so replacing L by a positive tensor power does not change the Hilbert–Mumford inequalities defining semistability or stability. Hence, after replacing L by a sufficiently high tensor power, the general projective GIT problem reduces to the linear action on a projective space.

Theorem 1.14.

Let 𝐺 be a reductive group acting on an affine space 𝑉. If 𝑣∈𝑉 and 0∈――――𝐺⋅𝑣, then there is a 1-PS 𝜆 of 𝐺 such that lim𝑡→0𝜆(𝑡)⋅𝑣=0.

Proposition 1.15.

For a reductive group 𝐺 acting on a projective scheme 𝑋⊆ℙ𝑛 linearly, fix a maximal torus 𝑇<𝐺. For 𝑥∈𝑋, the following statements hold.

  1. (a)

    𝑥 is 𝐺-(semi)stable ⟺ 𝑔⋅𝑥 is 𝑇-(semi)stable for all 𝑔∈𝐺.

  2. (b)

    𝑥 is 𝑇-semistable ⟺ 0∈𝑐𝑜𝑛𝑣(𝑤𝑡𝑇(𝑥)).

  3. (c)

    𝑥 is 𝑇-stable ⟺ 0∈𝐼𝑛𝑡(𝑐𝑜𝑛𝑣(𝑤𝑡𝑇(𝑥))).

Proposition 1.16 (Semistability for binary forms).

Consider the action of 𝑆𝐿2 on the space of degree 𝑑 binary forms ℙ𝑑=ℙ(𝑘[𝑥,𝑦]𝑑). For 𝑝𝐹∈ℙ𝑑 corresponding to 𝐹(𝑥,𝑦)∈𝑘[𝑥,𝑦]𝑑, then

  1. (a)

    𝐹 is semistable ⟺ all roots of 𝐹 have multiplicity ≤𝑑/2.

  2. (b)

    𝐹 is stable ⟺ all roots of 𝐹 have multiplicity <𝑑/2.

2 Hilbert–Mumford criterion for genus 3 curves

The discussion in this section is inspired by [ART09]. Throughout this section, let 𝑘 be an algebraically closed field of characteristic 0.

2.1 Non-hyperelliptic curves of genus 3: plane quartics

Let 𝐶 be a smooth projective curve of genus 3. By [VAK25] 19.7.3, 𝐶 is not hyperelliptic ⟺ the canonical map describes 𝐶 as a degree 4 curve in ℙ2.

Let 𝑊=𝑘3, with coordinates 𝑋,𝑌,𝑍, and set

𝑋4:=ℙ(Sym4⁡𝑊∨).

A point [𝐹]∈𝑋4 represents the plane quartic

𝐶𝐹={𝐹=0}⊂ℙ(𝑊).

The group PGL⁡(𝑊) acts on 𝑋4 by change of coordinates. Hence the moduli problem of non-hyperelliptic genus 3 curves is described by the quotient of the open locus

𝑈4:={[𝐹]∈𝑋4:𝐶𝐹 is smooth}

by PGL3.

Let

𝜆:𝔾𝑚→SL⁡(𝑊)

be a one-parameter subgroup. After a change of coordinates, we may assume

𝜆(𝑡)=diag⁡(𝑡𝑎,𝑡𝑏,𝑡𝑐),𝑎≥𝑏≥𝑐,𝑎+𝑏+𝑐=0.

Writing

𝐹=∑𝑖+𝑗+𝑘=4𝑐𝑖𝑗𝑘𝑋𝑖𝑌𝑗𝑍𝑘,

the monomial 𝑋𝑖𝑌𝑗𝑍𝑘 has 𝜆-weight

𝑎𝑖+𝑏𝑗+𝑐𝑘.

Thus

wt𝜆⁡(𝐹)={𝑎𝑖+𝑏𝑗+𝑐𝑘:𝑐𝑖𝑗𝑘≠0}.
Proposition 2.1.

Every smooth plane quartic is PGL3-stable for the natural PGL3-linearisation on

ℙ(Sym4⁡𝑊∨).

Proof.

By the Hilbert–Mumford criterion, it suffices to show that for every non-trivial one-parameter subgroup 𝜆, the occurring weights of 𝐹 contain both a negative and a positive weight.

Write

𝜆(𝑡)=diag⁡(𝑡𝑎,𝑡𝑏,𝑡𝑐),𝑎≥𝑏≥𝑐,𝑎+𝑏+𝑐=0.

Since 𝜆 is non-trivial, we have

𝑎>0,𝑐<0.

Suppose first that every monomial occurring in 𝐹 has non-negative 𝜆-weight. Consider the point

𝑃=[0:0:1].

The monomials

𝑍4,𝑋𝑍3,𝑌𝑍3

have weights

4𝑐,𝑎+3𝑐,𝑏+3𝑐.

These are all negative. Indeed,

4𝑐<0.

Moreover, since 𝑎=−𝑏−𝑐 and 𝑏≥𝑐, we have

𝑎≤−2𝑐,

and hence

𝑎+3𝑐≤𝑐<0.

Also

𝑏+3𝑐=−𝑎+2𝑐<0.

Therefore none of the monomials

𝑍4,𝑋𝑍3,𝑌𝑍3

occurs in 𝐹.

On the affine chart 𝑍≠0, with coordinates

𝑢=𝑋𝑍,𝑣=𝑌𝑍,

the polynomial 𝐹/𝑍4 has zero constant term and zero linear terms at (𝑢,𝑣)=(0,0). Hence

𝐹(𝑃)=𝐹𝑋(𝑃)=𝐹𝑌(𝑃)=0.

By Euler’s identity

𝑋𝐹𝑋+𝑌𝐹𝑌+𝑍𝐹𝑍=4𝐹,

we also get

𝐹𝑍(𝑃)=0.

Thus 𝑃 is a singular point of 𝐶𝐹, contradicting smoothness. Hence some occurring monomial has negative 𝜆-weight.

Applying the same argument to 𝜆−1, some occurring monomial has positive 𝜆-weight. Therefore

minwt𝜆⁡(𝐹)<0<maxwt𝜆⁡(𝐹).

Equivalently,

0∈Int⁡conv⁡(wt𝜆⁡(𝐹))

for every non-trivial 𝜆. Hence [𝐹] is PGL3 stable. ∎

Consequently, every smooth plane quartic defines a PGL3-stable point of

𝑋4=ℙ(Sym4⁡𝑊∨).

Equivalently,

𝑈4⊂𝑋𝑠,PGL34.

Thus the geometric quotient

𝑈4/PGL3

parametrizes smooth plane quartics. Since the canonical embedding of a non-hyperelliptic curve of genus 3 realizes it as a smooth plane quartic, and since isomorphisms of curves preserve the canonical linear system, this quotient parametrizes non-hyperelliptic smooth curves of genus 3.

2.2 Hyperelliptic curves of genus 3: binary octics

A hyperelliptic curve of genus 3 is a double cover

𝐶⟶ℙ1

branched over a divisor of degree

2𝑔+2=8.

After choosing homogeneous coordinates 𝑋,𝑌 on ℙ1, such a curve can be written as

𝐶𝑓:𝑧2=𝑓(𝑋,𝑌),

where

𝑓∈Sym8⁡𝑘2

is a binary octic. The curve 𝐶𝑓 is smooth if and only if 𝑓 has eight distinct roots on ℙ1.

Thus the parameter space is

𝑋8:=ℙ(Sym8⁡𝑘2),

with the natural action of

PGL2⁡.

The hyperelliptic locus H3 is described by the quotient of the square-free binary octics by PGL2.

Proposition 2.2.

Let 𝑓 be a binary octic. Then [𝑓]∈ℙ(Sym8⁡𝑘2) is PGL2 semistable if and only if

𝑚𝑝(𝑓)≤4for all 𝑝∈ℙ1.

It is PGL2 stable if and only if

𝑚𝑝(𝑓)≤3for all 𝑝∈ℙ1.

Proof.

A binary octic is a binary form of degree 8. After choosing homogeneous coordinates 𝑋,𝑌 on ℙ1, we have an identification

Sym8⁡𝑘2≅𝑘[𝑋,𝑌]8.

Thus

ℙ(Sym8⁡𝑘2)≅ℙ(𝑘[𝑋,𝑌]8).

The stability and semistability conditions may be checked using the 𝑆𝐿2-action. Indeed, the center {±𝐼}⊂𝑆𝐿2 acts trivially on ℙ(Sym8⁡𝑘2), since −𝐼 acts on a degree 8 binary form by multiplication by (−1)8=1. Hence the induced 𝑆𝐿2-stability and PGL2-stability conditions agree.

For each point 𝑝∈ℙ1, let 𝑚𝑝(𝑓) denote the multiplicity of 𝑝 as a root of the homogeneous binary form 𝑓. Applying Proposition 1.16 with 𝑑=8, we obtain

[𝑓] is semistable⟺every root of 𝑓 has multiplicity ≤82.

Since 82=4, this is equivalent to

𝑚𝑝(𝑓)≤4for all 𝑝∈ℙ1.

This proves the semistability statement.

Similarly, Proposition 1.16 gives

[𝑓] is stable⟺every root of 𝑓 has multiplicity <82.

Equivalently,

𝑚𝑝(𝑓)<4for all 𝑝∈ℙ1.

Since 𝑚𝑝(𝑓) is an integer, this is equivalent to

𝑚𝑝(𝑓)≤3for all 𝑝∈ℙ1.

This proves the proposition. ∎

In particular, every square-free binary octic defines a PGL2-stable point of

𝑋8=ℙ(Sym8⁡𝑘2).

Equivalently,

𝑈sf8⊂𝑋𝑠,PGL28,

where

𝑈sf8:={[𝑓]∈𝑋8:𝑓 is square-free}.

Thus the geometric quotient

𝑈sf8/PGL2

parametrizes reduced effective divisors of degree 8 on ℙ1 up to projective change of coordinates. Equivalently, it parametrizes smooth hyperelliptic curves of genus 3.

2.3 Summary

In this section, we applied the Hilbert–Mumford criterion to smooth curves of genus 3. The main point is that genus 3 curves naturally split into two types: non-hyperelliptic curves, which are represented by plane quartics, and hyperelliptic curves, which are represented by binary octics.

For the non-hyperelliptic case, let 𝑊=𝑘3 and

𝑋4:=ℙ(Sym4⁡𝑊∨).

A point [𝐹]∈𝑋4 defines a plane quartic

𝐶𝐹={𝐹=0}⊂ℙ(𝑊).

Let

𝑈4:={[𝐹]∈𝑋4:𝐶𝐹 is smooth}.

We proved that every point of 𝑈4 is PGL3-stable. Hence

𝑈4⊂𝑋𝑠,PGL34,

and the quotient

𝑈4/PGL3

parametrizes non-hyperelliptic smooth curves of genus 3.

For the hyperelliptic case, a smooth curve of genus 3 is a double cover of ℙ1 branched over a reduced divisor of degree 8. Thus it is represented by a square-free binary octic. Let

𝑋8:=ℙ(Sym8⁡𝑘2),𝑈sf8:={[𝑓]∈𝑋8:𝑓 is square-free}.

Using the Hilbert–Mumford criterion for binary forms, we proved that [𝑓]∈𝑋8 is PGL2-stable if and only if

𝑚𝑝(𝑓)≤3for all 𝑝∈ℙ1.

Since every square-free binary octic has only simple roots, we have

𝑈sf8⊂𝑋𝑠,PGL28.

Therefore

𝑈sf8/PGL2

parametrizes smooth hyperelliptic curves of genus 3.

Therefore, in both the non-hyperelliptic and hyperelliptic cases, smooth curves of genus 3 give stable points for the relevant projective parameter spaces.

References

  • [ART09] M. Artebani (2009) A compactification of M3 via K3 surfaces. Nagoya Mathematical Journal 196, pp. 1–26. Cited by: §2.
  • [HOS23] V. Hoskins (2023) Moduli spaces and geometric invariant theory: old and new perspectives. External Links: 2302.14499, Link Cited by: §1.
  • [MFK94] D. Mumford, J. Fogarty, and F. Kirwan (1994) Geometric invariant theory. 3 edition, Ergebnisse der Mathematik und ihrer Grenzgebiete, Vol. 34, Springer-Verlag, Berlin. Cited by: §1.
  • [VAK25] R. Vakil (2025) The rising sea: foundations of algebraic geometry. Princeton University Press. External Links: ISBN 9780691268668 Cited by: §2.1.