{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "(target-dj-fetching-data)=\n",
    "# DataJoint pipeline: Fetching data as DataFrames\n",
    "\n",
    ":::{important}\n",
    "This guide assumes you have a [DataJoint pipeline deployed](target-dj-pipeline-deployment) with [data already ingested](target-dj-data-ingestion-processing).\n",
    ":::\n",
    "\n",
    "This guide builds upon the [Querying data](target-dj-querying-data) guide and provides further examples on fetching various kinds of data as `pandas.DataFrames` from the [Aeon DataJoint pipeline](target-aeon-dj-pipeline).\n",
    "\n",
    "You can also run this notebook online at [`works.datajoint.com`](https://works.datajoint.com/) using the following credentials:\n",
    " - Username: aeondemo\n",
    " - Password: aeon_djworks \n",
    "\n",
    "To access it, go to the Notebook tab at the top and in the File Browser on the left, navigate to `ucl-swc_aeon > docs > examples`, where this notebook `dj_fetching_data.ipynb` is located.\n",
    "\n",
    ":::{note}\n",
    "The examples here use the _social_ period of the [social0.2-aeon4](target-full-datasets) dataset.\n",
    "Since the social period spans 2 weeks, we limit retrieval to the first 3 days to keep the examples concise.\n",
    "\n",
    "If you are using a different dataset, be sure to replace the experiment name and parameters in the code below accordingly.\n",
    ":::"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "vscode": {
     "languageId": "plaintext"
    }
   },
   "source": [
    "## Import libraries and define variables and helper functions"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "from datetime import datetime\n",
    "import warnings\n",
    "\n",
    "import numpy as np\n",
    "import pandas as pd\n",
    "\n",
    "from aeon.dj_pipeline import acquisition, streams, subject, tracking\n",
    "from aeon.dj_pipeline.analysis.block_analysis import (\n",
    "    Block,\n",
    "    BlockAnalysis,\n",
    "    BlockSubjectAnalysis,\n",
    "    get_foraging_bouts,\n",
    ")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "def ensure_ts_arr_datetime(array):\n",
    "    \"\"\"Ensure array is a numpy array of datetime64[ns] type.\"\"\"\n",
    "    if len(array) == 0:\n",
    "        return np.array([], dtype=\"datetime64[ns]\")\n",
    "    else:\n",
    "        return np.array(array, dtype=\"datetime64[ns]\")\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "exp = {\n",
    "    \"name\": \"social0.2-aeon4\",\n",
    "    \"presocial_start\": \"2024-01-31 11:00:00\",\n",
    "    \"presocial_end\": \"2024-02-08 15:00:00\",\n",
    "    \"social_start\": \"2024-02-09 17:00:00\",\n",
    "    \"social_end\": \"2024-02-23 12:00:00\",\n",
    "    \"postsocial_start\": \"2024-02-25 18:00:00\",\n",
    "    \"postsocial_end\": \"2024-03-02 13:00:00\",\n",
    "}\n",
    "key = {\"experiment_name\": exp[\"name\"]}\n",
    "# Define periods\n",
    "periods = {\n",
    "    \"presocial\": (exp[\"presocial_start\"], exp[\"presocial_end\"]),\n",
    "    \"social\": (exp[\"social_start\"], exp[\"social_end\"]),\n",
    "    \"postsocial\": (exp[\"postsocial_start\"], exp[\"postsocial_end\"]),\n",
    "}\n",
    "# Select the social period and limit to first 3 days for brevity\n",
    "period_name = \"social\"\n",
    "start = periods[period_name][0]\n",
    "start_dt = datetime.strptime(start, \"%Y-%m-%d %H:%M:%S\")\n",
    "end_dt = start_dt + pd.Timedelta(days=3)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Patch data\n",
    "\n",
    "In this section, we will fetch [foraging patch](target-foraging-patch)-related data for each {term}`Block`.\n",
    "The data includes:\n",
    "- **patch information**: wheel timestamps, patch rate, and patch offset for each block\n",
    "- **subject patch data**: subjects' interactions with patches, including information on their presence in patches (duration, timestamps, RFID detections), pellet consumption (count, timestamps), and wheel movement (distance travelled)\n",
    "- **subject patch preferences**: preferences of subjects for different patches"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "def load_subject_patch_data(\n",
    "    key: dict[str, str], period_start: str, period_end: str\n",
    ") -> tuple[pd.DataFrame, pd.DataFrame, pd.DataFrame]:\n",
    "    \"\"\"Loads subject patch data for a specified time period.\n",
    "\n",
    "    Args:\n",
    "        key (dict): The key to filter the subject patch data.\n",
    "        period_start (str): The start time for the period.\n",
    "        period_end (str): The end time for the period.\n",
    "\n",
    "    Returns:\n",
    "        tuple: A tuple containing:\n",
    "            - patch_info (pd.DataFrame): Information about patches.\n",
    "            - block_subject_patch_data (pd.DataFrame): Data for the specified period.\n",
    "            - block_subject_patch_pref (pd.DataFrame): Preference data for the specified period.\n",
    "    \"\"\"\n",
    "    patch_info = (\n",
    "        BlockAnalysis.Patch()\n",
    "        & key\n",
    "        & f\"block_start >= '{period_start}'\"\n",
    "        & f\"block_start <= '{period_end}'\"\n",
    "    ).fetch(\n",
    "        \"block_start\",\n",
    "        \"patch_name\",\n",
    "        \"patch_rate\",\n",
    "        \"patch_offset\",\n",
    "        \"wheel_timestamps\",\n",
    "        as_dict=True,\n",
    "    )\n",
    "\n",
    "    block_subject_patch_data = (\n",
    "        BlockSubjectAnalysis.Patch()\n",
    "        & key\n",
    "        & f\"block_start >= '{period_start}'\"\n",
    "        & f\"block_start <= '{period_end}'\"\n",
    "    ).fetch(format=\"frame\")\n",
    "\n",
    "    block_subject_patch_pref = (\n",
    "        BlockSubjectAnalysis.Preference()\n",
    "        & key\n",
    "        & f\"block_start >= '{period_start}'\"\n",
    "        & f\"block_start <= '{period_end}'\"\n",
    "    ).fetch(format=\"frame\")\n",
    "\n",
    "    if patch_info:\n",
    "        patch_info = pd.DataFrame(patch_info)\n",
    "\n",
    "    if isinstance(block_subject_patch_data, pd.DataFrame) and not block_subject_patch_data.empty:\n",
    "        block_subject_patch_data.reset_index(inplace=True)\n",
    "\n",
    "    if isinstance(block_subject_patch_pref, pd.DataFrame) and not block_subject_patch_pref.empty:\n",
    "        block_subject_patch_pref.reset_index(inplace=True)\n",
    "\n",
    "    return patch_info, block_subject_patch_data, block_subject_patch_pref"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [],
   "source": [
    "block_patch_info, block_subject_patch_data, block_subject_patch_pref = load_subject_patch_data(key, start_dt, end_dt)\n",
    "\n",
    "# Drop NaNs in preference columns\n",
    "block_subject_patch_pref = block_subject_patch_pref.dropna(subset=[\"final_preference_by_time\", \"final_preference_by_wheel\"])\n",
    "\n",
    "# Validate subject count for pre/post-social blocks\n",
    "if period_name in [\"presocial\", \"postsocial\"] and not block_subject_patch_data.empty:\n",
    "    n_subjects = block_subject_patch_data.groupby(\"block_start\")[\"subject_name\"].nunique()\n",
    "    if (n_subjects != 1).any():\n",
    "        warnings.warn(\n",
    "            f\"{exp['name']} {period_name} blocks have >1 subject. Data may need cleaning.\"\n",
    "        )\n",
    "\n",
    "# Ensure timestamp arrays are datetime64[ns]\n",
    "for col in [\"pellet_timestamps\", \"in_patch_rfid_timestamps\", \"in_patch_timestamps\"]:\n",
    "    if col in block_subject_patch_data.columns:\n",
    "        block_subject_patch_data[col] = block_subject_patch_data[col].apply(ensure_ts_arr_datetime)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>block_start</th>\n",
       "      <th>patch_name</th>\n",
       "      <th>wheel_timestamps</th>\n",
       "      <th>patch_rate</th>\n",
       "      <th>patch_offset</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2024-02-09 18:19:04.000000</td>\n",
       "      <td>Patch1</td>\n",
       "      <td>[2024-02-09T18:19:04.000000000, 2024-02-09T18:...</td>\n",
       "      <td>0.0100</td>\n",
       "      <td>75.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2024-02-09 18:19:04.000000</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>[2024-02-09T18:19:04.000000000, 2024-02-09T18:...</td>\n",
       "      <td>0.0020</td>\n",
       "      <td>75.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2024-02-09 18:19:04.000000</td>\n",
       "      <td>Patch3</td>\n",
       "      <td>[2024-02-09T18:19:04.000000000, 2024-02-09T18:...</td>\n",
       "      <td>0.0033</td>\n",
       "      <td>75.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2024-02-09 20:07:25.041984</td>\n",
       "      <td>Patch1</td>\n",
       "      <td>[2024-02-09T20:07:25.060000000, 2024-02-09T20:...</td>\n",
       "      <td>0.0020</td>\n",
       "      <td>75.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2024-02-09 20:07:25.041984</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>[2024-02-09T20:07:25.060000000, 2024-02-09T20:...</td>\n",
       "      <td>0.0033</td>\n",
       "      <td>75.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>109</th>\n",
       "      <td>2024-02-12 14:31:02.005984</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>[2024-02-12T14:31:02.020000000, 2024-02-12T14:...</td>\n",
       "      <td>0.0033</td>\n",
       "      <td>75.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>110</th>\n",
       "      <td>2024-02-12 14:31:02.005984</td>\n",
       "      <td>Patch3</td>\n",
       "      <td>[2024-02-12T14:31:02.020000000, 2024-02-12T14:...</td>\n",
       "      <td>0.0100</td>\n",
       "      <td>75.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>111</th>\n",
       "      <td>2024-02-12 16:53:14.000000</td>\n",
       "      <td>Patch1</td>\n",
       "      <td>[2024-02-12T16:53:14.000000000, 2024-02-12T16:...</td>\n",
       "      <td>0.0020</td>\n",
       "      <td>75.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>112</th>\n",
       "      <td>2024-02-12 16:53:14.000000</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>[2024-02-12T16:53:14.000000000, 2024-02-12T16:...</td>\n",
       "      <td>0.0100</td>\n",
       "      <td>75.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>113</th>\n",
       "      <td>2024-02-12 16:53:14.000000</td>\n",
       "      <td>Patch3</td>\n",
       "      <td>[2024-02-12T16:53:14.000000000, 2024-02-12T16:...</td>\n",
       "      <td>0.0033</td>\n",
       "      <td>75.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>114 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                   block_start patch_name  \\\n",
       "0   2024-02-09 18:19:04.000000     Patch1   \n",
       "1   2024-02-09 18:19:04.000000     Patch2   \n",
       "2   2024-02-09 18:19:04.000000     Patch3   \n",
       "3   2024-02-09 20:07:25.041984     Patch1   \n",
       "4   2024-02-09 20:07:25.041984     Patch2   \n",
       "..                         ...        ...   \n",
       "109 2024-02-12 14:31:02.005984     Patch2   \n",
       "110 2024-02-12 14:31:02.005984     Patch3   \n",
       "111 2024-02-12 16:53:14.000000     Patch1   \n",
       "112 2024-02-12 16:53:14.000000     Patch2   \n",
       "113 2024-02-12 16:53:14.000000     Patch3   \n",
       "\n",
       "                                      wheel_timestamps  patch_rate  \\\n",
       "0    [2024-02-09T18:19:04.000000000, 2024-02-09T18:...      0.0100   \n",
       "1    [2024-02-09T18:19:04.000000000, 2024-02-09T18:...      0.0020   \n",
       "2    [2024-02-09T18:19:04.000000000, 2024-02-09T18:...      0.0033   \n",
       "3    [2024-02-09T20:07:25.060000000, 2024-02-09T20:...      0.0020   \n",
       "4    [2024-02-09T20:07:25.060000000, 2024-02-09T20:...      0.0033   \n",
       "..                                                 ...         ...   \n",
       "109  [2024-02-12T14:31:02.020000000, 2024-02-12T14:...      0.0033   \n",
       "110  [2024-02-12T14:31:02.020000000, 2024-02-12T14:...      0.0100   \n",
       "111  [2024-02-12T16:53:14.000000000, 2024-02-12T16:...      0.0020   \n",
       "112  [2024-02-12T16:53:14.000000000, 2024-02-12T16:...      0.0100   \n",
       "113  [2024-02-12T16:53:14.000000000, 2024-02-12T16:...      0.0033   \n",
       "\n",
       "     patch_offset  \n",
       "0            75.0  \n",
       "1            75.0  \n",
       "2            75.0  \n",
       "3            75.0  \n",
       "4            75.0  \n",
       "..            ...  \n",
       "109          75.0  \n",
       "110          75.0  \n",
       "111          75.0  \n",
       "112          75.0  \n",
       "113          75.0  \n",
       "\n",
       "[114 rows x 5 columns]"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "block_patch_info"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>experiment_name</th>\n",
       "      <th>block_start</th>\n",
       "      <th>patch_name</th>\n",
       "      <th>subject_name</th>\n",
       "      <th>in_patch_timestamps</th>\n",
       "      <th>in_patch_time</th>\n",
       "      <th>in_patch_rfid_timestamps</th>\n",
       "      <th>pellet_count</th>\n",
       "      <th>pellet_timestamps</th>\n",
       "      <th>patch_threshold</th>\n",
       "      <th>wheel_cumsum_distance_travelled</th>\n",
       "      <th>period</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 18:19:04</td>\n",
       "      <td>Patch1</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>[2024-02-09T18:26:44.600000000, 2024-02-09T18:...</td>\n",
       "      <td>756.60</td>\n",
       "      <td>[2024-02-09T18:26:45.736672000, 2024-02-09T18:...</td>\n",
       "      <td>39</td>\n",
       "      <td>[2024-02-09T18:26:50.373504000, 2024-02-09T18:...</td>\n",
       "      <td>[125.10144062824004, 125.98842043772429, 133.9...</td>\n",
       "      <td>[-0.0, 0.004602223261072957, 0.007670372101788...</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 18:19:04</td>\n",
       "      <td>Patch1</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>[2024-02-09T18:21:10.200000000, 2024-02-09T18:...</td>\n",
       "      <td>570.18</td>\n",
       "      <td>[2024-02-09T18:21:11.452832000, 2024-02-09T18:...</td>\n",
       "      <td>26</td>\n",
       "      <td>[2024-02-09T18:28:57.907488000, 2024-02-09T18:...</td>\n",
       "      <td>[75.07162358109204, 186.27023735234684, 135.82...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 18:19:04</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>[2024-02-09T18:20:10.400000000, 2024-02-09T18:...</td>\n",
       "      <td>123.32</td>\n",
       "      <td>[2024-02-09T18:20:12.097312000, 2024-02-09T18:...</td>\n",
       "      <td>0</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[-0.0, -0.004602223261073846, -0.0015340744203...</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 18:19:04</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>[2024-02-09T18:20:54.600000000, 2024-02-09T18:...</td>\n",
       "      <td>226.80</td>\n",
       "      <td>[2024-02-09T18:21:30.375328000, 2024-02-09T18:...</td>\n",
       "      <td>3</td>\n",
       "      <td>[2024-02-09T18:52:14.199488000, 2024-02-09T19:...</td>\n",
       "      <td>[1069.4286592499257, 694.8095229017808, 278.84...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 18:19:04</td>\n",
       "      <td>Patch3</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>[2024-02-09T18:20:03.940000000, 2024-02-09T18:...</td>\n",
       "      <td>138.78</td>\n",
       "      <td>[2024-02-09T18:25:59.113504000, 2024-02-09T18:...</td>\n",
       "      <td>1</td>\n",
       "      <td>[2024-02-09T19:30:22.688480000]</td>\n",
       "      <td>[331.8480024096391]</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>223</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 16:53:14</td>\n",
       "      <td>Patch1</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>[2024-02-12T17:01:34.760000000, 2024-02-12T17:...</td>\n",
       "      <td>94.98</td>\n",
       "      <td>[2024-02-12T17:01:35.372416000, 2024-02-12T17:...</td>\n",
       "      <td>0</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[-0.0, -0.00920444652214547, -0.00613629768143...</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>224</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 16:53:14</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>[2024-02-12T16:58:52.540000000, 2024-02-12T16:...</td>\n",
       "      <td>627.76</td>\n",
       "      <td>[2024-02-12T16:58:53.758496000, 2024-02-12T16:...</td>\n",
       "      <td>18</td>\n",
       "      <td>[2024-02-12T17:01:47.607488000, 2024-02-12T17:...</td>\n",
       "      <td>[128.88388967189582, 98.29740841703715, 138.54...</td>\n",
       "      <td>[-0.0, 0.0030681488407182655, 0.00306814884071...</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>225</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 16:53:14</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>[2024-02-12T16:53:55.360000000, 2024-02-12T16:...</td>\n",
       "      <td>1215.12</td>\n",
       "      <td>[2024-02-12T16:53:56.698656000, 2024-02-12T16:...</td>\n",
       "      <td>34</td>\n",
       "      <td>[2024-02-12T16:57:31.338496000, 2024-02-12T16:...</td>\n",
       "      <td>[245.09652119007265, 137.19851472663964, 129.5...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>226</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 16:53:14</td>\n",
       "      <td>Patch3</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>[2024-02-12T16:58:45.920000000, 2024-02-12T16:...</td>\n",
       "      <td>101.68</td>\n",
       "      <td>[2024-02-12T16:58:47.270432000, 2024-02-12T16:...</td>\n",
       "      <td>0</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[-0.0, 0.0, -0.006136297681431202, -0.00460222...</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>227</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 16:53:14</td>\n",
       "      <td>Patch3</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>[2024-02-12T17:01:20.200000000, 2024-02-12T17:...</td>\n",
       "      <td>48.12</td>\n",
       "      <td>[2024-02-12T17:01:22.861888000, 2024-02-12T17:...</td>\n",
       "      <td>0</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>228 rows × 12 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "     experiment_name         block_start patch_name subject_name  \\\n",
       "0    social0.2-aeon4 2024-02-09 18:19:04     Patch1  BAA-1104048   \n",
       "1    social0.2-aeon4 2024-02-09 18:19:04     Patch1  BAA-1104049   \n",
       "2    social0.2-aeon4 2024-02-09 18:19:04     Patch2  BAA-1104048   \n",
       "3    social0.2-aeon4 2024-02-09 18:19:04     Patch2  BAA-1104049   \n",
       "4    social0.2-aeon4 2024-02-09 18:19:04     Patch3  BAA-1104048   \n",
       "..               ...                 ...        ...          ...   \n",
       "223  social0.2-aeon4 2024-02-12 16:53:14     Patch1  BAA-1104049   \n",
       "224  social0.2-aeon4 2024-02-12 16:53:14     Patch2  BAA-1104048   \n",
       "225  social0.2-aeon4 2024-02-12 16:53:14     Patch2  BAA-1104049   \n",
       "226  social0.2-aeon4 2024-02-12 16:53:14     Patch3  BAA-1104048   \n",
       "227  social0.2-aeon4 2024-02-12 16:53:14     Patch3  BAA-1104049   \n",
       "\n",
       "                                   in_patch_timestamps  in_patch_time  \\\n",
       "0    [2024-02-09T18:26:44.600000000, 2024-02-09T18:...         756.60   \n",
       "1    [2024-02-09T18:21:10.200000000, 2024-02-09T18:...         570.18   \n",
       "2    [2024-02-09T18:20:10.400000000, 2024-02-09T18:...         123.32   \n",
       "3    [2024-02-09T18:20:54.600000000, 2024-02-09T18:...         226.80   \n",
       "4    [2024-02-09T18:20:03.940000000, 2024-02-09T18:...         138.78   \n",
       "..                                                 ...            ...   \n",
       "223  [2024-02-12T17:01:34.760000000, 2024-02-12T17:...          94.98   \n",
       "224  [2024-02-12T16:58:52.540000000, 2024-02-12T16:...         627.76   \n",
       "225  [2024-02-12T16:53:55.360000000, 2024-02-12T16:...        1215.12   \n",
       "226  [2024-02-12T16:58:45.920000000, 2024-02-12T16:...         101.68   \n",
       "227  [2024-02-12T17:01:20.200000000, 2024-02-12T17:...          48.12   \n",
       "\n",
       "                              in_patch_rfid_timestamps  pellet_count  \\\n",
       "0    [2024-02-09T18:26:45.736672000, 2024-02-09T18:...            39   \n",
       "1    [2024-02-09T18:21:11.452832000, 2024-02-09T18:...            26   \n",
       "2    [2024-02-09T18:20:12.097312000, 2024-02-09T18:...             0   \n",
       "3    [2024-02-09T18:21:30.375328000, 2024-02-09T18:...             3   \n",
       "4    [2024-02-09T18:25:59.113504000, 2024-02-09T18:...             1   \n",
       "..                                                 ...           ...   \n",
       "223  [2024-02-12T17:01:35.372416000, 2024-02-12T17:...             0   \n",
       "224  [2024-02-12T16:58:53.758496000, 2024-02-12T16:...            18   \n",
       "225  [2024-02-12T16:53:56.698656000, 2024-02-12T16:...            34   \n",
       "226  [2024-02-12T16:58:47.270432000, 2024-02-12T16:...             0   \n",
       "227  [2024-02-12T17:01:22.861888000, 2024-02-12T17:...             0   \n",
       "\n",
       "                                     pellet_timestamps  \\\n",
       "0    [2024-02-09T18:26:50.373504000, 2024-02-09T18:...   \n",
       "1    [2024-02-09T18:28:57.907488000, 2024-02-09T18:...   \n",
       "2                                                   []   \n",
       "3    [2024-02-09T18:52:14.199488000, 2024-02-09T19:...   \n",
       "4                      [2024-02-09T19:30:22.688480000]   \n",
       "..                                                 ...   \n",
       "223                                                 []   \n",
       "224  [2024-02-12T17:01:47.607488000, 2024-02-12T17:...   \n",
       "225  [2024-02-12T16:57:31.338496000, 2024-02-12T16:...   \n",
       "226                                                 []   \n",
       "227                                                 []   \n",
       "\n",
       "                                       patch_threshold  \\\n",
       "0    [125.10144062824004, 125.98842043772429, 133.9...   \n",
       "1    [75.07162358109204, 186.27023735234684, 135.82...   \n",
       "2                                                   []   \n",
       "3    [1069.4286592499257, 694.8095229017808, 278.84...   \n",
       "4                                  [331.8480024096391]   \n",
       "..                                                 ...   \n",
       "223                                                 []   \n",
       "224  [128.88388967189582, 98.29740841703715, 138.54...   \n",
       "225  [245.09652119007265, 137.19851472663964, 129.5...   \n",
       "226                                                 []   \n",
       "227                                                 []   \n",
       "\n",
       "                       wheel_cumsum_distance_travelled  period  \n",
       "0    [-0.0, 0.004602223261072957, 0.007670372101788...  social  \n",
       "1    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  social  \n",
       "2    [-0.0, -0.004602223261073846, -0.0015340744203...  social  \n",
       "3    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  social  \n",
       "4    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  social  \n",
       "..                                                 ...     ...  \n",
       "223  [-0.0, -0.00920444652214547, -0.00613629768143...  social  \n",
       "224  [-0.0, 0.0030681488407182655, 0.00306814884071...  social  \n",
       "225  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  social  \n",
       "226  [-0.0, 0.0, -0.006136297681431202, -0.00460222...  social  \n",
       "227  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...  social  \n",
       "\n",
       "[228 rows x 12 columns]"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "block_subject_patch_data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>experiment_name</th>\n",
       "      <th>block_start</th>\n",
       "      <th>patch_name</th>\n",
       "      <th>subject_name</th>\n",
       "      <th>cumulative_preference_by_wheel</th>\n",
       "      <th>cumulative_preference_by_time</th>\n",
       "      <th>running_preference_by_time</th>\n",
       "      <th>running_preference_by_wheel</th>\n",
       "      <th>final_preference_by_wheel</th>\n",
       "      <th>final_preference_by_time</th>\n",
       "      <th>period</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 18:19:04</td>\n",
       "      <td>Patch1</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>0.758947</td>\n",
       "      <td>0.742711</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 18:19:04</td>\n",
       "      <td>Patch1</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>0.548170</td>\n",
       "      <td>0.574604</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 18:19:04</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>0.096201</td>\n",
       "      <td>0.121056</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 18:19:04</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>0.251308</td>\n",
       "      <td>0.228560</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 18:19:04</td>\n",
       "      <td>Patch3</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>0.144852</td>\n",
       "      <td>0.136232</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>223</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 16:53:14</td>\n",
       "      <td>Patch1</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>0.038067</td>\n",
       "      <td>0.069930</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>224</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 16:53:14</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>0.831808</td>\n",
       "      <td>0.778163</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>225</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 16:53:14</td>\n",
       "      <td>Patch2</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>0.955588</td>\n",
       "      <td>0.894642</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>226</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 16:53:14</td>\n",
       "      <td>Patch3</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>0.162096</td>\n",
       "      <td>0.126041</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>227</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 16:53:14</td>\n",
       "      <td>Patch3</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...</td>\n",
       "      <td>0.006345</td>\n",
       "      <td>0.035429</td>\n",
       "      <td>social</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>162 rows × 11 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "     experiment_name         block_start patch_name subject_name  \\\n",
       "0    social0.2-aeon4 2024-02-09 18:19:04     Patch1  BAA-1104048   \n",
       "1    social0.2-aeon4 2024-02-09 18:19:04     Patch1  BAA-1104049   \n",
       "2    social0.2-aeon4 2024-02-09 18:19:04     Patch2  BAA-1104048   \n",
       "3    social0.2-aeon4 2024-02-09 18:19:04     Patch2  BAA-1104049   \n",
       "4    social0.2-aeon4 2024-02-09 18:19:04     Patch3  BAA-1104048   \n",
       "..               ...                 ...        ...          ...   \n",
       "223  social0.2-aeon4 2024-02-12 16:53:14     Patch1  BAA-1104049   \n",
       "224  social0.2-aeon4 2024-02-12 16:53:14     Patch2  BAA-1104048   \n",
       "225  social0.2-aeon4 2024-02-12 16:53:14     Patch2  BAA-1104049   \n",
       "226  social0.2-aeon4 2024-02-12 16:53:14     Patch3  BAA-1104048   \n",
       "227  social0.2-aeon4 2024-02-12 16:53:14     Patch3  BAA-1104049   \n",
       "\n",
       "                        cumulative_preference_by_wheel  \\\n",
       "0    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "1    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "2    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "3    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "4    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "..                                                 ...   \n",
       "223  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "224  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "225  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "226  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "227  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "\n",
       "                         cumulative_preference_by_time  \\\n",
       "0    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "1    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "2    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "3    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "4    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "..                                                 ...   \n",
       "223  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "224  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "225  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "226  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "227  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "\n",
       "                            running_preference_by_time  \\\n",
       "0    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "1    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "2    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "3    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "4    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "..                                                 ...   \n",
       "223  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "224  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "225  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "226  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "227  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "\n",
       "                           running_preference_by_wheel  \\\n",
       "0    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "1    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "2    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "3    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "4    [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "..                                                 ...   \n",
       "223  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "224  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "225  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "226  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "227  [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ...   \n",
       "\n",
       "     final_preference_by_wheel  final_preference_by_time  period  \n",
       "0                     0.758947                  0.742711  social  \n",
       "1                     0.548170                  0.574604  social  \n",
       "2                     0.096201                  0.121056  social  \n",
       "3                     0.251308                  0.228560  social  \n",
       "4                     0.144852                  0.136232  social  \n",
       "..                         ...                       ...     ...  \n",
       "223                   0.038067                  0.069930  social  \n",
       "224                   0.831808                  0.778163  social  \n",
       "225                   0.955588                  0.894642  social  \n",
       "226                   0.162096                  0.126041  social  \n",
       "227                   0.006345                  0.035429  social  \n",
       "\n",
       "[162 rows x 11 columns]"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "block_subject_patch_pref"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Foraging bouts\n",
    "\n",
    "Here we will use the `block_analysis.get_foraging_bouts()` function to retrieve foraging bout data for each subject across all {term}`blocks <Block>`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "def load_foraging_bouts(\n",
    "    key: dict[str, str], period_start: str, period_end: str\n",
    ") -> pd.DataFrame:\n",
    "    \"\"\"Loads foraging bout data for blocks falling within a specified time period.\n",
    "\n",
    "    Args:\n",
    "        key (dict): Key to identify experiment data (e.g., {\"experiment_name\": \"Exp1\"}).\n",
    "        period_start (str): Start datetime of the time period (format: '%Y-%m-%d %H:%M:%S').\n",
    "        period_end (str): End datetime of the time period (format: '%Y-%m-%d %H:%M:%S').\n",
    "\n",
    "    Returns:\n",
    "        pd.DataFrame: Concatenated dataframe of foraging bouts for all matching blocks.\n",
    "                      Returns an empty dataframe with predefined columns if no data found.\n",
    "    \"\"\"\n",
    "    # Fetch block start times within the specified period\n",
    "    blocks = (\n",
    "        Block & key & f\"block_start >= '{period_start}'\" & f\"block_end <= '{period_end}'\"\n",
    "    ).fetch(\"block_start\")\n",
    "\n",
    "    # Retrieve foraging bouts for each block\n",
    "    bouts = []\n",
    "    for block_start in blocks:\n",
    "        block_key = key | {\"block_start\": str(block_start)}\n",
    "        bouts.append(get_foraging_bouts(block_key, min_pellets=1))\n",
    "\n",
    "    # Return concatenated DataFrame or empty fallback\n",
    "    if bouts:\n",
    "        return pd.concat(bouts, ignore_index=True)\n",
    "    else:\n",
    "        return pd.DataFrame(\n",
    "            columns=[\"start\", \"end\", \"n_pellets\", \"cum_wheel_dist\", \"subject\"]\n",
    "        )\n",
    "\n",
    "# Load foraging bouts\n",
    "foraging_df = load_foraging_bouts(key, start_dt, end_dt)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>start</th>\n",
       "      <th>end</th>\n",
       "      <th>n_pellets</th>\n",
       "      <th>cum_wheel_dist</th>\n",
       "      <th>subject</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2024-02-09 18:26:07.280</td>\n",
       "      <td>2024-02-09 18:27:51.460</td>\n",
       "      <td>1</td>\n",
       "      <td>458.105303</td>\n",
       "      <td>BAA-1104048</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2024-02-09 18:28:26.720</td>\n",
       "      <td>2024-02-09 18:30:25.440</td>\n",
       "      <td>1</td>\n",
       "      <td>464.014558</td>\n",
       "      <td>BAA-1104049</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2024-02-09 18:36:49.760</td>\n",
       "      <td>2024-02-09 18:38:21.360</td>\n",
       "      <td>2</td>\n",
       "      <td>240.621107</td>\n",
       "      <td>BAA-1104049</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2024-02-09 18:39:17.180</td>\n",
       "      <td>2024-02-09 18:42:14.880</td>\n",
       "      <td>7</td>\n",
       "      <td>983.174489</td>\n",
       "      <td>BAA-1104048</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2024-02-09 18:43:02.440</td>\n",
       "      <td>2024-02-09 18:44:35.480</td>\n",
       "      <td>1</td>\n",
       "      <td>247.676315</td>\n",
       "      <td>BAA-1104049</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>327</th>\n",
       "      <td>2024-02-12 16:24:17.660</td>\n",
       "      <td>2024-02-12 16:26:56.160</td>\n",
       "      <td>3</td>\n",
       "      <td>680.642741</td>\n",
       "      <td>BAA-1104048</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>328</th>\n",
       "      <td>2024-02-12 16:30:04.740</td>\n",
       "      <td>2024-02-12 16:33:20.300</td>\n",
       "      <td>3</td>\n",
       "      <td>981.212408</td>\n",
       "      <td>BAA-1104048</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>329</th>\n",
       "      <td>2024-02-12 16:38:32.840</td>\n",
       "      <td>2024-02-12 16:43:16.600</td>\n",
       "      <td>3</td>\n",
       "      <td>2384.391929</td>\n",
       "      <td>BAA-1104048</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>330</th>\n",
       "      <td>2024-02-12 16:49:39.380</td>\n",
       "      <td>2024-02-12 16:51:38.920</td>\n",
       "      <td>1</td>\n",
       "      <td>321.695406</td>\n",
       "      <td>BAA-1104049</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>331</th>\n",
       "      <td>2024-02-12 16:51:21.440</td>\n",
       "      <td>2024-02-12 16:53:12.640</td>\n",
       "      <td>2</td>\n",
       "      <td>423.237326</td>\n",
       "      <td>BAA-1104048</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>332 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                      start                     end n_pellets  cum_wheel_dist  \\\n",
       "0   2024-02-09 18:26:07.280 2024-02-09 18:27:51.460         1      458.105303   \n",
       "1   2024-02-09 18:28:26.720 2024-02-09 18:30:25.440         1      464.014558   \n",
       "2   2024-02-09 18:36:49.760 2024-02-09 18:38:21.360         2      240.621107   \n",
       "3   2024-02-09 18:39:17.180 2024-02-09 18:42:14.880         7      983.174489   \n",
       "4   2024-02-09 18:43:02.440 2024-02-09 18:44:35.480         1      247.676315   \n",
       "..                      ...                     ...       ...             ...   \n",
       "327 2024-02-12 16:24:17.660 2024-02-12 16:26:56.160         3      680.642741   \n",
       "328 2024-02-12 16:30:04.740 2024-02-12 16:33:20.300         3      981.212408   \n",
       "329 2024-02-12 16:38:32.840 2024-02-12 16:43:16.600         3     2384.391929   \n",
       "330 2024-02-12 16:49:39.380 2024-02-12 16:51:38.920         1      321.695406   \n",
       "331 2024-02-12 16:51:21.440 2024-02-12 16:53:12.640         2      423.237326   \n",
       "\n",
       "         subject  \n",
       "0    BAA-1104048  \n",
       "1    BAA-1104049  \n",
       "2    BAA-1104049  \n",
       "3    BAA-1104048  \n",
       "4    BAA-1104049  \n",
       "..           ...  \n",
       "327  BAA-1104048  \n",
       "328  BAA-1104048  \n",
       "329  BAA-1104048  \n",
       "330  BAA-1104049  \n",
       "331  BAA-1104048  \n",
       "\n",
       "[332 rows x 5 columns]"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "foraging_df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## RFID data\n",
    "\n",
    "In this experiment, each subject is implanted with a miniature RFID microchip.\n",
    "RFID readers are positioned at the [foraging patches](target-foraging-patch), [nest](target-nest), and [gate](target-habitat).\n",
    "\n",
    "We will fetch the RFID detection data at each reader across all {term}`chunks <Acquisition Chunk>` occurring within the first 3 days of the social period."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [],
   "source": [
    "def load_rfid_events(\n",
    "    key: dict[str, str], period_start: str, period_end: str\n",
    ") -> pd.DataFrame:\n",
    "    \"\"\"Loads RFID events data for chunks falling within a specified time period.\n",
    "\n",
    "    Args:\n",
    "        key (dict): Key to identify experiment data (e.g., {\"experiment_name\": \"Exp1\"}).\n",
    "        period_start (str): Start datetime of the time period (format: '%Y-%m-%d %H:%M:%S').\n",
    "        period_end (str): End datetime of the time period (format: '%Y-%m-%d %H:%M:%S').\n",
    "\n",
    "    Returns:\n",
    "        pd.DataFrame: DataFrame containing RFID events for the specified period.\n",
    "                      Returns an empty dataframe with predefined columns if no data found.\n",
    "    \"\"\"\n",
    "    # Fetch RFID events within the specified period\n",
    "    rfid_events_df = (\n",
    "        streams.RfidReader * streams.RfidReaderRfidEvents\n",
    "        & key\n",
    "        & f'chunk_start >= \"{period_start}\"'\n",
    "        & f'chunk_start <= \"{period_end}\"'\n",
    "    ).fetch(format=\"frame\")\n",
    "\n",
    "    if rfid_events_df.empty or not isinstance(rfid_events_df, pd.DataFrame):\n",
    "        # Return empty DataFrame with expected columns if no data found\n",
    "        return pd.DataFrame(\n",
    "            columns=[\n",
    "                \"experiment_name\",\n",
    "                \"chunk_start\",\n",
    "                \"rfid_reader_name\",\n",
    "                \"sample_count\",\n",
    "                \"timestamps\",\n",
    "                \"rfid\",\n",
    "            ]\n",
    "        )\n",
    "\n",
    "    # Get subject details for RFID mapping\n",
    "    subject_detail = subject.SubjectDetail.fetch(format=\"frame\")\n",
    "    subject_detail.reset_index(inplace=True)\n",
    "\n",
    "    # Create mapping from RFID to subject ID\n",
    "    rfid_to_lab_id = dict(zip(subject_detail[\"lab_id\"], subject_detail[\"subject\"]))\n",
    "\n",
    "    rfid_events_df[\"rfid\"] = [\n",
    "        [rfid_to_lab_id.get(str(rfid)) for rfid in rfid_array]\n",
    "        for rfid_array in rfid_events_df[\"rfid\"]\n",
    "    ]\n",
    "\n",
    "    # Extract experiment_name and chunk_start from the index before resetting\n",
    "    rfid_events_df[\"experiment_name\"] = [idx[0] for idx in rfid_events_df.index]\n",
    "    rfid_events_df[\"chunk_start\"] = [\n",
    "        idx[3] for idx in rfid_events_df.index\n",
    "    ]  # Assuming chunk_start is at index 3\n",
    "\n",
    "    # Reset the index and drop the index column\n",
    "    rfid_events_df = rfid_events_df.reset_index(drop=True)\n",
    "\n",
    "    # Reorder columns to put experiment_name first and chunk_start second\n",
    "    cols = [\"experiment_name\", \"chunk_start\"] + [\n",
    "        col\n",
    "        for col in rfid_events_df.columns\n",
    "        if col not in [\"experiment_name\", \"chunk_start\"]\n",
    "    ]\n",
    "    rfid_events_df = rfid_events_df[cols]\n",
    "\n",
    "    return rfid_events_df\n",
    "\n",
    "# Load RFID data\n",
    "rfid_df = load_rfid_events(key, start_dt, end_dt)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>experiment_name</th>\n",
       "      <th>chunk_start</th>\n",
       "      <th>rfid_reader_name</th>\n",
       "      <th>sample_count</th>\n",
       "      <th>timestamps</th>\n",
       "      <th>rfid</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 17:00:00</td>\n",
       "      <td>Patch1Rfid</td>\n",
       "      <td>844</td>\n",
       "      <td>[2024-02-09T17:00:00.483007908, 2024-02-09T17:...</td>\n",
       "      <td>[BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 18:00:00</td>\n",
       "      <td>Patch1Rfid</td>\n",
       "      <td>857</td>\n",
       "      <td>[2024-02-09T18:01:41.768191814, 2024-02-09T18:...</td>\n",
       "      <td>[BAA-1104049, BAA-1104048, BAA-1104048, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 19:00:00</td>\n",
       "      <td>Patch1Rfid</td>\n",
       "      <td>1262</td>\n",
       "      <td>[2024-02-09T19:04:08.140863895, 2024-02-09T19:...</td>\n",
       "      <td>[BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 20:00:00</td>\n",
       "      <td>Patch1Rfid</td>\n",
       "      <td>301</td>\n",
       "      <td>[2024-02-09T20:05:47.786528111, 2024-02-09T20:...</td>\n",
       "      <td>[BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-09 21:00:00</td>\n",
       "      <td>Patch1Rfid</td>\n",
       "      <td>0</td>\n",
       "      <td>[]</td>\n",
       "      <td>[]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>433</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 13:00:00</td>\n",
       "      <td>Patch3Rfid</td>\n",
       "      <td>336</td>\n",
       "      <td>[2024-02-12T13:05:10.713151932, 2024-02-12T13:...</td>\n",
       "      <td>[BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>434</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 14:00:00</td>\n",
       "      <td>Patch3Rfid</td>\n",
       "      <td>323</td>\n",
       "      <td>[2024-02-12T14:01:47.358272076, 2024-02-12T14:...</td>\n",
       "      <td>[BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>435</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 15:00:00</td>\n",
       "      <td>Patch3Rfid</td>\n",
       "      <td>19</td>\n",
       "      <td>[2024-02-12T15:12:24.588128090, 2024-02-12T15:...</td>\n",
       "      <td>[BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>436</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 16:00:00</td>\n",
       "      <td>Patch3Rfid</td>\n",
       "      <td>139</td>\n",
       "      <td>[2024-02-12T16:03:41.951839924, 2024-02-12T16:...</td>\n",
       "      <td>[BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>437</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>2024-02-12 17:00:00</td>\n",
       "      <td>Patch3Rfid</td>\n",
       "      <td>183</td>\n",
       "      <td>[2024-02-12T17:01:05.555712223, 2024-02-12T17:...</td>\n",
       "      <td>[BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>438 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "     experiment_name         chunk_start rfid_reader_name  sample_count  \\\n",
       "0    social0.2-aeon4 2024-02-09 17:00:00       Patch1Rfid           844   \n",
       "1    social0.2-aeon4 2024-02-09 18:00:00       Patch1Rfid           857   \n",
       "2    social0.2-aeon4 2024-02-09 19:00:00       Patch1Rfid          1262   \n",
       "3    social0.2-aeon4 2024-02-09 20:00:00       Patch1Rfid           301   \n",
       "4    social0.2-aeon4 2024-02-09 21:00:00       Patch1Rfid             0   \n",
       "..               ...                 ...              ...           ...   \n",
       "433  social0.2-aeon4 2024-02-12 13:00:00       Patch3Rfid           336   \n",
       "434  social0.2-aeon4 2024-02-12 14:00:00       Patch3Rfid           323   \n",
       "435  social0.2-aeon4 2024-02-12 15:00:00       Patch3Rfid            19   \n",
       "436  social0.2-aeon4 2024-02-12 16:00:00       Patch3Rfid           139   \n",
       "437  social0.2-aeon4 2024-02-12 17:00:00       Patch3Rfid           183   \n",
       "\n",
       "                                            timestamps  \\\n",
       "0    [2024-02-09T17:00:00.483007908, 2024-02-09T17:...   \n",
       "1    [2024-02-09T18:01:41.768191814, 2024-02-09T18:...   \n",
       "2    [2024-02-09T19:04:08.140863895, 2024-02-09T19:...   \n",
       "3    [2024-02-09T20:05:47.786528111, 2024-02-09T20:...   \n",
       "4                                                   []   \n",
       "..                                                 ...   \n",
       "433  [2024-02-12T13:05:10.713151932, 2024-02-12T13:...   \n",
       "434  [2024-02-12T14:01:47.358272076, 2024-02-12T14:...   \n",
       "435  [2024-02-12T15:12:24.588128090, 2024-02-12T15:...   \n",
       "436  [2024-02-12T16:03:41.951839924, 2024-02-12T16:...   \n",
       "437  [2024-02-12T17:01:05.555712223, 2024-02-12T17:...   \n",
       "\n",
       "                                                  rfid  \n",
       "0    [BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...  \n",
       "1    [BAA-1104049, BAA-1104048, BAA-1104048, BAA-11...  \n",
       "2    [BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...  \n",
       "3    [BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...  \n",
       "4                                                   []  \n",
       "..                                                 ...  \n",
       "433  [BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...  \n",
       "434  [BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...  \n",
       "435  [BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...  \n",
       "436  [BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...  \n",
       "437  [BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...  \n",
       "\n",
       "[438 rows x 6 columns]"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "rfid_df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Position data\n",
    "\n",
    "In this section, we will fetch SLEAP position data (centroid only) from the `tracking.DenoisedTracking` table for each subject across all {term}`chunks <Acquisition Chunk>` occurring within the first 3 days of the social period.\n",
    "\n",
    ":::{note}\n",
    "The full pose data (all tracked body parts) can be fetched from the `tracking.SLEAPTracking.Part` table.\n",
    ":::"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "  Querying data from 2024-02-09 17:00:00 to 2024-02-12 17:00:00...\n",
      "  Retrieved 20211079 rows of position data\n"
     ]
    }
   ],
   "source": [
    "def load_position_data(\n",
    "    key: dict[str, str], period_start: str, period_end: str\n",
    ") -> pd.DataFrame:\n",
    "    \"\"\"Loads position data (centroid tracking) for a specified time period.\n",
    "\n",
    "    Args:\n",
    "        key (dict): Key to identify experiment data (e.g., {\"experiment_name\": \"Exp1\"}).\n",
    "        period_start (str): Start datetime of the time period.\n",
    "        period_end (str): End datetime of the time period.\n",
    "\n",
    "    Returns:\n",
    "        pd.DataFrame: DataFrame containing position data for the specified period.\n",
    "                     Returns an empty DataFrame if no data found.\n",
    "    \"\"\"\n",
    "    try:\n",
    "        print(f\"  Querying data from {period_start} to {period_end}...\")\n",
    "\n",
    "        # Create chunk restriction for the time period\n",
    "        chunk_restriction = acquisition.create_chunk_restriction(\n",
    "            key[\"experiment_name\"], period_start, period_end\n",
    "        )\n",
    "\n",
    "        # Fetch centroid tracking data for the specified period\n",
    "        centroid_df = (\n",
    "            streams.SpinnakerVideoSource * tracking.DenoisedTracking.Subject\n",
    "            & key\n",
    "            & {\"spinnaker_video_source_name\": \"CameraTop\"}\n",
    "            & chunk_restriction\n",
    "        ).fetch(format=\"frame\")\n",
    "\n",
    "        centroid_df = centroid_df.reset_index()\n",
    "        centroid_df = centroid_df.rename(\n",
    "            columns={\n",
    "                \"subject_name\": \"identity_name\",\n",
    "                \"timestamps\": \"time\",\n",
    "                \"subject_likelihood\": \"identity_likelihood\",\n",
    "            }\n",
    "        )\n",
    "        centroid_df = centroid_df.explode(\n",
    "            [\"time\", \"identity_likelihood\", \"x\", \"y\", \"likelihood\"]\n",
    "        )\n",
    "        centroid_df = centroid_df[\n",
    "            [\n",
    "                \"time\",\n",
    "                \"experiment_name\",\n",
    "                \"identity_name\",\n",
    "                \"identity_likelihood\",\n",
    "                \"x\",\n",
    "                \"y\",\n",
    "                \"likelihood\",\n",
    "            ]\n",
    "        ].set_index(\"time\")\n",
    "\n",
    "        # Clean up the dataframe\n",
    "        if isinstance(centroid_df, pd.DataFrame) and not centroid_df.empty:\n",
    "            if \"spinnaker_video_source_name\" in centroid_df.columns:\n",
    "                centroid_df.drop(columns=[\"spinnaker_video_source_name\"], inplace=True)\n",
    "            print(f\"  Retrieved {len(centroid_df)} rows of position data\")\n",
    "        else:\n",
    "            print(\"  No data found for the specified period\")\n",
    "\n",
    "        return centroid_df\n",
    "\n",
    "    except Exception as e:\n",
    "        print(\n",
    "            f\"  Error loading position data for {key['experiment_name']} ({period_start} \"\n",
    "            f\"to {period_end}): {e}\"\n",
    "        )\n",
    "        return pd.DataFrame()\n",
    "\n",
    "\n",
    "# Load position data\n",
    "# If this takes too long, consider changing end_dt to an earlier time\n",
    "position_df = load_position_data(key, start_dt, end_dt).sort_index()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>experiment_name</th>\n",
       "      <th>identity_name</th>\n",
       "      <th>identity_likelihood</th>\n",
       "      <th>x</th>\n",
       "      <th>y</th>\n",
       "      <th>likelihood</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>time</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>2024-02-09 16:48:10.660</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1280.208496</td>\n",
       "      <td>550.073364</td>\n",
       "      <td>0.971199</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-09 16:48:10.660</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>0.102343</td>\n",
       "      <td>1232.14624</td>\n",
       "      <td>558.113037</td>\n",
       "      <td>0.971199</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-09 16:48:10.680</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>0.021459</td>\n",
       "      <td>1282.991699</td>\n",
       "      <td>552.229248</td>\n",
       "      <td>0.985731</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-09 16:48:10.680</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1232.227051</td>\n",
       "      <td>560.120911</td>\n",
       "      <td>0.985731</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-09 16:48:10.700</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1283.058105</td>\n",
       "      <td>552.201538</td>\n",
       "      <td>0.963831</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-12 17:59:59.460</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>0.971221</td>\n",
       "      <td>1213.701416</td>\n",
       "      <td>544.300171</td>\n",
       "      <td>0.709776</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-12 17:59:59.480</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>0.997087</td>\n",
       "      <td>1211.169434</td>\n",
       "      <td>531.434387</td>\n",
       "      <td>0.709763</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-12 17:59:59.480</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>0.971762</td>\n",
       "      <td>1213.696045</td>\n",
       "      <td>544.309204</td>\n",
       "      <td>0.709763</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-12 17:59:59.500</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>BAA-1104048</td>\n",
       "      <td>0.996872</td>\n",
       "      <td>1211.168945</td>\n",
       "      <td>531.43396</td>\n",
       "      <td>0.709618</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-12 17:59:59.500</th>\n",
       "      <td>social0.2-aeon4</td>\n",
       "      <td>BAA-1104049</td>\n",
       "      <td>0.971445</td>\n",
       "      <td>1213.696045</td>\n",
       "      <td>544.309326</td>\n",
       "      <td>0.709618</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>20211079 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                         experiment_name identity_name identity_likelihood  \\\n",
       "time                                                                         \n",
       "2024-02-09 16:48:10.660  social0.2-aeon4   BAA-1104048                 NaN   \n",
       "2024-02-09 16:48:10.660  social0.2-aeon4   BAA-1104049            0.102343   \n",
       "2024-02-09 16:48:10.680  social0.2-aeon4   BAA-1104049            0.021459   \n",
       "2024-02-09 16:48:10.680  social0.2-aeon4   BAA-1104048                 NaN   \n",
       "2024-02-09 16:48:10.700  social0.2-aeon4   BAA-1104048                 NaN   \n",
       "...                                  ...           ...                 ...   \n",
       "2024-02-12 17:59:59.460  social0.2-aeon4   BAA-1104049            0.971221   \n",
       "2024-02-12 17:59:59.480  social0.2-aeon4   BAA-1104048            0.997087   \n",
       "2024-02-12 17:59:59.480  social0.2-aeon4   BAA-1104049            0.971762   \n",
       "2024-02-12 17:59:59.500  social0.2-aeon4   BAA-1104048            0.996872   \n",
       "2024-02-12 17:59:59.500  social0.2-aeon4   BAA-1104049            0.971445   \n",
       "\n",
       "                                   x           y likelihood  \n",
       "time                                                         \n",
       "2024-02-09 16:48:10.660  1280.208496  550.073364   0.971199  \n",
       "2024-02-09 16:48:10.660   1232.14624  558.113037   0.971199  \n",
       "2024-02-09 16:48:10.680  1282.991699  552.229248   0.985731  \n",
       "2024-02-09 16:48:10.680  1232.227051  560.120911   0.985731  \n",
       "2024-02-09 16:48:10.700  1283.058105  552.201538   0.963831  \n",
       "...                              ...         ...        ...  \n",
       "2024-02-12 17:59:59.460  1213.701416  544.300171   0.709776  \n",
       "2024-02-12 17:59:59.480  1211.169434  531.434387   0.709763  \n",
       "2024-02-12 17:59:59.480  1213.696045  544.309204   0.709763  \n",
       "2024-02-12 17:59:59.500  1211.168945   531.43396   0.709618  \n",
       "2024-02-12 17:59:59.500  1213.696045  544.309326   0.709618  \n",
       "\n",
       "[20211079 rows x 6 columns]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "position_df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Weight data\n",
    "\n",
    "A weighing scale integrated into the [nest](target-nest) records the weight data for each subject whenever a subject is alone in the nest. \n",
    "\n",
    "Here we will fetch the weight data for each subject across all {term}`chunks <Acquisition Chunk>` occurring within the first 3 days of the social period."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [],
   "source": [
    "def load_weight_data(\n",
    "    key: dict[str, str], period_start: str, period_end: str\n",
    ") -> pd.DataFrame:\n",
    "    \"\"\"Loads weight data for a specified time period.\n",
    "\n",
    "    Args:\n",
    "        key (dict): Key to identify experiment data (e.g., {\"experiment_name\": \"Exp1\"}).\n",
    "        period_start (str): Start datetime of the time period (format: '%Y-%m-%d %H:%M:%S').\n",
    "        period_end (str): End datetime of the time period (format: '%Y-%m-%d %H:%M:%S').\n",
    "\n",
    "    Returns:\n",
    "        pd.DataFrame: Weight data for the specified period.\n",
    "                      Returns an empty dataframe if no data found.\n",
    "    \"\"\"\n",
    "    try:\n",
    "        weight_df = (\n",
    "            acquisition.Environment.SubjectWeight\n",
    "            & key\n",
    "            & f\"chunk_start >= '{period_start}'\"\n",
    "            & f\"chunk_start <= '{period_end}'\"\n",
    "        ).proj(\"timestamps\", \"weight\", \"subject_id\").fetch(format=\"frame\")\n",
    "        return weight_df if not weight_df.empty and isinstance(weight_df, pd.DataFrame) else pd.DataFrame()\n",
    "    except Exception as e:\n",
    "        print(\n",
    "            f\"Error loading weight data for {key} from {period_start} to {period_end}: {e}\"\n",
    "        )\n",
    "        return pd.DataFrame()\n",
    "\n",
    "\n",
    "weight_df = load_weight_data(key, start_dt, end_dt)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th>timestamps</th>\n",
       "      <th>weight</th>\n",
       "      <th>subject_id</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>experiment_name</th>\n",
       "      <th>chunk_start</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th rowspan=\"11\" valign=\"top\">social0.2-aeon4</th>\n",
       "      <th>2024-02-09 17:00:00</th>\n",
       "      <td>[2024-02-09T17:12:29.800000191, 2024-02-09T17:...</td>\n",
       "      <td>[23.522316, 23.522316, 23.522316, 23.522316, 2...</td>\n",
       "      <td>[BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-09 18:00:00</th>\n",
       "      <td>[2024-02-09T18:07:53.019999981, 2024-02-09T18:...</td>\n",
       "      <td>[25.6000004, 25.6000004, 25.6000004, 25.600000...</td>\n",
       "      <td>[BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-09 19:00:00</th>\n",
       "      <td>[2024-02-09T19:04:08.159999847, 2024-02-09T19:...</td>\n",
       "      <td>[27.4697571, 27.4697571, 27.4697571, 27.469757...</td>\n",
       "      <td>[BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-09 20:00:00</th>\n",
       "      <td>[2024-02-09T20:20:22.920000076, 2024-02-09T20:...</td>\n",
       "      <td>[31.3124409, 11.8549995]</td>\n",
       "      <td>[BAA-1104049, BAA-1104049]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-09 21:00:00</th>\n",
       "      <td>[2024-02-09T21:08:21.480000019, 2024-02-09T21:...</td>\n",
       "      <td>[21.3240242, 21.3240242, 21.3240242, 21.324024...</td>\n",
       "      <td>[BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-12 13:00:00</th>\n",
       "      <td>[2024-02-12T13:01:20.599999905, 2024-02-12T13:...</td>\n",
       "      <td>[28.2491455, 28.2541466, 28.2541466, 28.254146...</td>\n",
       "      <td>[BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-12 14:00:00</th>\n",
       "      <td>[2024-02-12T14:15:02.300000191, 2024-02-12T14:...</td>\n",
       "      <td>[28.2345123, 28.2345123, 28.2345123, 28.234512...</td>\n",
       "      <td>[BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-12 15:00:00</th>\n",
       "      <td>[2024-02-12T15:12:41.400000095, 2024-02-12T15:...</td>\n",
       "      <td>[32.1000023, 32.1000023, 32.1000023, 32.100002...</td>\n",
       "      <td>[BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-12 16:00:00</th>\n",
       "      <td>[2024-02-12T16:12:17.960000038, 2024-02-12T16:...</td>\n",
       "      <td>[30.8999977, 30.8999977, 30.8999977, 30.899997...</td>\n",
       "      <td>[BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2024-02-12 17:00:00</th>\n",
       "      <td>[2024-02-12T17:02:20.840000153, 2024-02-12T17:...</td>\n",
       "      <td>[30.1764622, 29.99049, 29.99049, 29.99049, 29....</td>\n",
       "      <td>[BAA-1104049, BAA-1104048, BAA-1104048, BAA-11...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>73 rows × 3 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                            timestamps  \\\n",
       "experiment_name chunk_start                                                              \n",
       "social0.2-aeon4 2024-02-09 17:00:00  [2024-02-09T17:12:29.800000191, 2024-02-09T17:...   \n",
       "                2024-02-09 18:00:00  [2024-02-09T18:07:53.019999981, 2024-02-09T18:...   \n",
       "                2024-02-09 19:00:00  [2024-02-09T19:04:08.159999847, 2024-02-09T19:...   \n",
       "                2024-02-09 20:00:00  [2024-02-09T20:20:22.920000076, 2024-02-09T20:...   \n",
       "                2024-02-09 21:00:00  [2024-02-09T21:08:21.480000019, 2024-02-09T21:...   \n",
       "...                                                                                ...   \n",
       "                2024-02-12 13:00:00  [2024-02-12T13:01:20.599999905, 2024-02-12T13:...   \n",
       "                2024-02-12 14:00:00  [2024-02-12T14:15:02.300000191, 2024-02-12T14:...   \n",
       "                2024-02-12 15:00:00  [2024-02-12T15:12:41.400000095, 2024-02-12T15:...   \n",
       "                2024-02-12 16:00:00  [2024-02-12T16:12:17.960000038, 2024-02-12T16:...   \n",
       "                2024-02-12 17:00:00  [2024-02-12T17:02:20.840000153, 2024-02-12T17:...   \n",
       "\n",
       "                                                                                weight  \\\n",
       "experiment_name chunk_start                                                              \n",
       "social0.2-aeon4 2024-02-09 17:00:00  [23.522316, 23.522316, 23.522316, 23.522316, 2...   \n",
       "                2024-02-09 18:00:00  [25.6000004, 25.6000004, 25.6000004, 25.600000...   \n",
       "                2024-02-09 19:00:00  [27.4697571, 27.4697571, 27.4697571, 27.469757...   \n",
       "                2024-02-09 20:00:00                           [31.3124409, 11.8549995]   \n",
       "                2024-02-09 21:00:00  [21.3240242, 21.3240242, 21.3240242, 21.324024...   \n",
       "...                                                                                ...   \n",
       "                2024-02-12 13:00:00  [28.2491455, 28.2541466, 28.2541466, 28.254146...   \n",
       "                2024-02-12 14:00:00  [28.2345123, 28.2345123, 28.2345123, 28.234512...   \n",
       "                2024-02-12 15:00:00  [32.1000023, 32.1000023, 32.1000023, 32.100002...   \n",
       "                2024-02-12 16:00:00  [30.8999977, 30.8999977, 30.8999977, 30.899997...   \n",
       "                2024-02-12 17:00:00  [30.1764622, 29.99049, 29.99049, 29.99049, 29....   \n",
       "\n",
       "                                                                            subject_id  \n",
       "experiment_name chunk_start                                                             \n",
       "social0.2-aeon4 2024-02-09 17:00:00  [BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...  \n",
       "                2024-02-09 18:00:00  [BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...  \n",
       "                2024-02-09 19:00:00  [BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...  \n",
       "                2024-02-09 20:00:00                         [BAA-1104049, BAA-1104049]  \n",
       "                2024-02-09 21:00:00  [BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...  \n",
       "...                                                                                ...  \n",
       "                2024-02-12 13:00:00  [BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...  \n",
       "                2024-02-12 14:00:00  [BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...  \n",
       "                2024-02-12 15:00:00  [BAA-1104048, BAA-1104048, BAA-1104048, BAA-11...  \n",
       "                2024-02-12 16:00:00  [BAA-1104049, BAA-1104049, BAA-1104049, BAA-11...  \n",
       "                2024-02-12 17:00:00  [BAA-1104049, BAA-1104048, BAA-1104048, BAA-11...  \n",
       "\n",
       "[73 rows x 3 columns]"
      ]
     },
     "execution_count": 37,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "weight_df"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "aeon",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.11.11"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}