The data problem
A social media user’s day-to-day behavior — posting, replying, lurking, resharing —
is naturally a sequence of categorical states rather than a continuous measurement.
Standard time-series and functional-data tools are built for numeric-valued curves,
which makes them a poor fit for this kind of densely observed categorical data.
Why ordinary vector representations are limiting
Treating each category as an arbitrary numeric code, or reducing a user’s trajectory
to a handful of summary counts, throws away the sequential and functional structure
of the data — the order and duration of behavioral states, not just their frequency.
Categorical-valued functional representation
This project develops a functional-data framework specifically for categorical
longitudinal data, using GAM-based modeling together with functional principal
component analysis to represent each trajectory as an underlying latent smooth
process rather than a raw category sequence.
Latent-process estimation and clustering
Once trajectories are represented in this latent functional space, standard
clustering methods can be applied to group users (or other units of observation) by
the shape of their behavioral trajectories rather than by simple aggregate counts.
The methodology was applied to cluster social media users by their categorical
behavioral trajectories, and to compare behavioral patterns across different social
media communities.
Software
The methods are implemented in catfda, an open-source R package available on
CRAN, co-developed by Chathura.
My contribution
Chathura co-developed the catfda package and is a co-author on the resulting Journal
of the American Statistical Association publication and the related HICSS proceedings
paper.
This project’s treatment of behavioral trajectories as functional data connects to
the broader statistical-methods theme, and its social-media application draws on the
same datasets and diffusion questions as the information-diffusion and influence work.