We attempt to generalize the notion of “normal subgroup,” used in studying kernels and homomorphisms, to a “normal subset” that does not have the requirement of being a subgroup, and we see whether it is possible for a normal subset to exist that is not a normal subgroup.
Definition. Let be a group. A normal subset
is such that, for all
we have
.
It turns out that with this could be empty, making it much harder to develop the theory of
. So we also require
to be nonempty.
Conjecture. is in fact a subgroup.
Attempt. There exists . Can we show the identity must be in
?
Let’s say that for some we had
. Then,
so commutes with
. By the same logic, it commutes with
.
We then have .
If we reverse this, then if is abelian, then there may be only one element in the conjugacy class of
, so that for all
we have
. In fact, for abelian groups, any subset is a normal subset. Thus, this conjecture is false; a normal subset is not necessarily a normal subgroup.
A normal subgroup can be motivated as having the properties for a kernel of a homomorphism. But a normal subset is an entirely different beast.
In fact, using the example of an abelian group, a normal subset need not be closed under multiplication; it need not have identity; it need not be closed under inverses; it may actually just be any old subset. More needs to be known about to deduce properties of its normal subsets.
Let’s reverse the question, then: if every normal subset of is a subgroup, what does that say about
?
We conjecture that this means that is “least abelian”, in the sense that no two elements commute. Wait, that wouldn’t work with powers …
Can we actually use this to develop an “abelian index” of a group? (Like a numerical measure of “how close the group is to being abelian.”) Something like:
Is it true that this number (or its analogue for infinite groups) is 1 if and only if the group is abelian? Can we show that the group is “least abelian” if the number of normal subsets that are not subgroups is 0?
How would we define “least abelian” here?
Let be a group; assume for now that
is finite. For all
, we can write
. If
and
commute, then this element is
. Thus, the number of distinct elements formed from
out of all choices of
is a measure of “how much
departs from being abelian”.
But we know that automatically commute if they are both powers of something. We have to be careful.
So consider all the possible that aren’t guaranteed to commute. For example, this excludes
and
being powers of something. Maybe that is the only case of guaranteed commutativity, although I’d want to do more work to check that. More precisely, we can define “guaranteed commutativity” as follows:
Definition. Let be a first-order statement about two elements of
. (For example,
could be “there exist
and
such that
. Actually, quantifying over positive integers is not something I think first-order logic supports, so we may have to modify this definition a bit.) We say that
guarantees commutativity if the group axioms imply that any two elements satisfying it commute.
Actually, rather than formalizing this via mathematical logic, we can just try to show that there exists a group where the only elements that commute are powers. Is this true? In other words, does there exist such that
commute if and only if there exist
and
such that
?
Regardless of how these questions turn out, let’s assume that we have some notion of identifying pairs of elements that have guaranteed commutativity. Then, we could define an “antiabelian index” like
Alternatively, we could define an antiabelian index like
The denominator refers to number of pairs such that, among those pairs,
for one
isn’t guaranteed to be equal to
for another.
Are these indices related or even equivalent?
Are the for
and
equal? (Does order matter?) Let
; then
is what? If
, then
, so these are inverses of each other. What if they are the same? Then
.
How are our antiabelian indices related to the normal-subsets abelian index above?
I suspect that generators will play a role in figuring this out. Let have generators
with orders
. Then the order of
is
. (EDIT, 02/2023: I’m not sure if I made a mistake of forgetting about generating relations between generators when first writing this. Also, I may have neglected order?)
It remains to investigate this further.
Written August 28, 2020. Edited and clarified some ideas on February 1, 2023.
—
Edit (Oct 2025): The term “normal subset” is in fact standard and already present in the literature, as seen in the ProofWiki page and the GroupProps page (both edited with the same definition before this article was written, so not circular), as well as in earlier research (see this paper.) So far, I’m not sure whether the abelian or anti-abelian indices are already present in the literature. It remains to investigate those further.
