This article has Open Peer Review reports available.

# Communication patterns in a psychotherapy following traumatic brain injury: A quantitative case study based on symbolic dynamics

- Paul E Rapp
^{1}Email author, - Christopher J Cellucci
^{2}, - Adele MK Gilpin
^{3, 4}, - Miguel A Jiménez-Montaño
^{5}and - Kathryn E Korslund
^{6}

**11**:119

https://doi.org/10.1186/1471-244X-11-119

© Rapp et al; licensee BioMed Central Ltd. 2011

**Received: **27 July 2010

**Accepted: **27 July 2011

**Published: **27 July 2011

## Abstract

### Background

The role of psychotherapy in the treatment of traumatic brain injury is receiving increased attention. The evaluation of psychotherapy with these patients has been conducted largely in the absence of quantitative data concerning the therapy itself. Quantitative methods for characterizing the sequence-sensitive structure of patient-therapist communication are now being developed with the objective of improving the effectiveness of psychotherapy following traumatic brain injury.

### Methods

The content of three therapy session transcripts (sessions were separated by four months) obtained from a patient with a history of several motor vehicle accidents who was receiving dialectical behavior therapy was scored and analyzed using methods derived from the mathematical theory of symbolic dynamics.

### Results

The analysis of symbol frequencies was largely uninformative. When repeated triples were examined a marked pattern of change in content was observed over the three sessions. The context free grammar complexity and the Lempel-Ziv complexity were calculated for each therapy session. For both measures, the rate of complexity generation, expressed as bits per minute, increased longitudinally during the course of therapy. The between-session increases in complexity generation rates are consistent with calculations of mutual information. Taken together these results indicate that there was a quantifiable increase in the variability of patient-therapist verbal behavior during the course of therapy. Comparison of complexity values against values obtained from equiprobable random surrogates established the presence of a nonrandom structure in patient-therapist dialog (P = .002).

### Conclusions

While recognizing that only limited conclusions can be based on a case history, it can be noted that these quantitative observations are consistent with qualitative clinical observations of increases in the flexibility of discourse during therapy. These procedures can be of particular value in the examination of therapies following traumatic brain injury because, in some presentations, these therapies are complicated by deficits that result in subtle distortions of language that produce significant post-injury social impairment. Independently of the mathematical analysis applied to the investigation of therapy-generated symbol sequences, our experience suggests that the procedures presented here are of value in training therapists.

## Keywords

**traumatic**brain injurypsychotherapypsychoanalysiscomplexitymutual informationentropyinformation theorysymbolic dynamics

## Background

Traumatic brain injury is a significant cause of acute and long-term disability. Neurobehavioral sequelae encompass cognitive, social and psychiatric domains. Major depressive disorder is the most prevalent psychiatric disorder following traumatic brain injury regardless of the severity of the injury [1–9]. Estimates of prevalence are highly varied. Iverson, et al. [10] reviewed six studies of depression following traumatic brain injury and found reports of prevalence ranging from 12% to 44%. While prevalence rates are uncertain, a critical conclusion can be made. The treatment of neuropsychiatric disorders following traumatic brain injury is a significant clinical need that presents unique clinical challenges.

As commonly conceptualized, the clinical response to traumatic brain injury has four components: neuroprotection (preserve injured neurons), plastic modification (reconstruct neural networks with surviving neurons by promoting dendritic arborization and synaptogenesis), neurogenesis (stimulate the maturation of new neurons from stem cell populations), and neurointegration (facilitate the integration of newly formed neurons into the central nervous system). It is increasingly recognized, however, that psychotherapy is an important complement to this neurological response. Cope [11] has argued that "the majority of recovering survivors of TBI are now seen as potentially benefiting from some form of psychotherapeutic/rehabilitation treatment." Nonetheless, most individuals experiencing a head injury do not receive psychotherapy. In a review of the early history of psychotherapy following TBI, Prigatano [12] addressed the question, "Why has the role of psychotherapeutic interventions in the rehabilitation care of TBI patients gone unrecognized?" He suggests that "the answer seems to lie in the assumption that TBI patients could not benefit from psychotherapy because of their permanent cognitive, linguistic and affective disturbances." While this argument might be advanced when considering severe TBI, it does not seem plausible in cases of mild TBI. But is it even applicable in the case of severe TBI? Results reported by Ben-Yishay et al. [13] and by Ezrachi, et al. [14] indicate that psychotherapy following moderate or severe TBI has a positive effect on post-injury employment.

While psychotherapy is the preferred approach to the treatment of mood disorders following traumatic brain injury [1, 2, 15–17] there is limited research to help guide the selection of the specific therapeutic method [18, 19]. The heterogeneity of this population demands a varied response. In part, the appropriate therapy will be determined by the physical injury, particularly the residual neurological and cognitive deficits. Individuals with TBI may benefit from treatments that take post-injury cognitive distortions into account [20–22]. The choice of therapy should also be responsive to pre-injury psychopathology [23, 24]. There is an emerging literature detailing the benefits of cognitive behavior therapy across a variety of medical patients with acquired brain injuries of various severities comorbid with mood disorders [15–18, 25, 26]. Psychodynamic psychotherapy has also been considered. While cognitive deficits following head injury can limit the individual's ability to profit from psychodynamic psychotherapy, this is not invariably the case. As Lewis and Rosenberg [27] observed in a paper describing psychoanalytic psychotherapy following brain injury, "the overriding principle that guides such psychotherapeutic work is that acquired brain lesions do not ablate the patient's psyche or unconscious." These authors have identified five criteria that can help identify candidates for psychoanalytic psychotherapy following brain injury. (1.) The patient must be motivated to enter and remain in therapy. (2.) Patients who have had at least one positive significant relationship in the past are better able to form a therapeutic alliance. (3.) Patients who have had previous successes resulting from active effort are more likely to benefit from individual therapy. (4.) Patients in extreme psychological distress may require a more supportive intervention, including hospitalization, before initiating psychoanalytic therapy. (5.) The degree and form of brain injury can affect the appropriateness of analytic treatment. Patients with significant expressive or receptive language deficits are not appropriate candidates. In addition to outlining the potential benefits of a psychodynamically oriented therapy for appropriately selected patients, Lewis and Rosenberg make two points that are generically applicable to the consideration of psychotherapy following traumatic brain injury. First, unaddressed psychological problems can be an impediment to meaningful participation in physical, cognitive and occupational rehabilitation, thus providing an additional argument for including psychotherapy in the treatment of some presentations of traumatic brain injury. Second, the patient's altered experience of self should not be viewed as an entirely neurological symptom. Brain injuries have psychological meaning.

"Although such disruptions (brain injury) can significantly affect the patient's self-esteem, and often represent a major focus for family work, they may represent a more basic and profound disturbance in the patients' sense of self. That is, beyond their difficulties in performing social roles, patients also struggle with the more fundamental question of who they are; the brain injury appears to disrupt severely their previously acquired self-image and sense of self [28]. Thus, a primary task of psychotherapy is to help the patient consolidate a new sense of self that successfully incorporates a realistic appraisal of strengths and weaknesses" [27].

In presentations where this alteration of sense of self is a significant element of the clinical presentation and the patient has sufficient ego development to tolerate an insight directed therapy, a psychodynamically informed therapy is indicated.

On reviewing psychotherapies appropriate for TBI patients, Folzer [29] made the following observation, "If 'immature' defenses and coping patterns are removed too early, the therapist may precipitate a catastrophe. Instead of directly confronting the patient, the therapist can introduce the focus on reality gradually." This would argue for a supportive therapy [30] instead of insight-oriented therapy. There is not, however, a strict division between these forms of therapy. As Werman [30] observed, "Although in the following pages these two forms of treatment (supportive therapy and insight-oriented therapy) are compared as if they were not only different from each other but virtually dichotomous in their aims and techniques, in reality they rarely exist in pure forms. Typically, over a period of time, most patients in supportive psychotherapy gain some insight into their behavior; similarly it is difficult to conceive of a course of insight-oriented psychotherapy in which some supportive measures are not utilized."

Psychotherapy following traumatic brain injury should not necessarily be limited to individual therapy. Several authors have emphasized the value of group therapy with TBI patients [29, 31, 32], and family involvement in therapy can be particularly important [12, 23].

The discussion of psychotherapy with TBI patients and indeed psychotherapy in general has been conducted largely in the absence of quantitative data concerning the therapy itself. While standardized instruments for assessing baseline symptoms and treatment outcomes are increasingly being used in clinical research [33], these instruments do not quantify the fine structure of the therapeutic interaction. This contribution continues the development of quantitative methods for the characterization of patient-therapist communication with the long term objective of improving the effectiveness of psychotherapy following traumatic brain injury. Communication between patients and therapist during psychotherapy has many components including posture, eye contact, verbal tone, verbal production (the number of words exchanged irrespective of their meaning) and the manifest content of the communication. All of these interactions can be examined quantitatively [34, 35]. For example non-verbal communication in the therapist-patient interaction has been analyzed by Yaynal-Reymond, et al. [36] and by Merten and Schwab [37] using a form of quantification developed by Magnusson [38, 39]. While all components of patient-therapist communication are important, this paper focuses on content analysis. Using methods of symbolic dynamics this investigation extends previous analyses of the frequency of content by quantifying the temporally dependent, sequence-sensitive structure of the dialog. As long-term goals, the questions addressed in this research program follow those enumerated in Rapp, et al. [40].

1. Are there nonrandom patterns in the sequential structure of patient-therapist communication?

2. Do these patterns, should they exist, change during the course of therapy?

3. Do changes in the patterns of patient-therapist communication correlate with the clinically perceived success or failure of the therapy?

4. Can this type of analysis identify more effective forms of therapist intervention?

This case study is limited to an examination of the first three questions in three therapy sessions recorded from one patient. Generalized conclusions cannot therefore be made. The limited results do, however, indicate that there is a nonrandom structure in patient-therapist communication in these protocols. Additionally, quantifiable structures changed during the course of therapy in a manner that correlated with the clinically perceived success of the therapy.

### Quantitative investigations of patient-therapist communication: Prior Research

A first approach to quantitative content analysis is the determination of word frequency. An early effort was Electronic Verbal Analysis [41] measuring the frequency of anxiety related words. In a subsequent study, Pennebaker, et al. [42, 43] recorded the frequency of 2800 words that were placed into seven categories, and Hart [44] analyzed political texts with a library of 10,000 words in five classes with approximately seven categories in each class. The limitations of these analyses are clear. Word frequency is insensitive to context. A randomly shuffled text will produced the same word counts. As Fast and Funder [45] observe, for example, the phrase "I am not happy" may be scored as positive emotional content.

Several investigators have developed methods that move beyond word frequency to examine meaning. A pioneer in this effort was Hartvig Dahl whose investigation of the case of Mrs. C analyzed 1,114 psychoanalytic sessions with the same patient [46–48]. In the 1974 study [48], entries in a three thousand word dictionary were assigned to one denotative category and to one or more connotative categories. A factor analysis was used to identify groups of related words, and it was shown that these groups were related to themes present in the transcript. In 1978 Dahl, et al. [49] published an application of linguistic analysis in psychotherapy that is intermediate to analysis of word count and the analysis of sequential structure based on symbolic dynamics presented in the next section. In this study, the analysis was limited to an examination of the therapist's interventions. This provides an instructive and valuable alternative to the practice of considering only the patient's speech. Each intervention by the therapist was classified by type and rated on scales designed to assess countertransference manifestations, including hostility, seductiveness, approval, disapproval and assertion of authority. A qualitative linguistic analysis based on Chomsky's model of transformational grammar [50, 51] was also implemented. Dahl and his colleagues hypothesized that "a speaker has available a variety of syntactic options, and the particular syntactic structure which he chooses reflects, among other things, the inventory of wishes that he is motivated both to conceal and to express." The analysis of examples presented in this paper shows occasions of extraposition, pseudocleft construction, syntactic ambiguity and lexical ambiguity consistent with this hypothesis.

In the Gottschalk-Gleser analysis procedure [52, 53], the grammatical clause is the unit of analysis. Content is scored on seven scales. In addition to the study of psychotherapy, Gottschalk-Gleser constant analysis has been applied in medical psychology [54–58]. GB Software markets a software product, PCAD2000, that applies a Gottschalk-Gleser content analysis to machine readable text. In addition to deriving scores on seven scales, the program offers a neuropsychiatric classification based on the DSM-IV.

Langs and colleagues [40, 59] analyzed each element of therapy transcripts on fourteen dimensions. The result is a content matrix of fourteen columns. The analysis included calculations of the frequency of each entry, Shannon information of each column and the context free grammar complexity (Jiménez-Montaño, [60] described in the next section of this paper and in Appendix One). In the 1991 study [40], two one-hour protocols obtained from the same patient with different therapist were analyzed by this procedure. One therapist was a classically trained psychoanalyst. The other therapist used a communicative approach developed by Langs [61]. The most notable differences between the two protocols were the frequency of scores for the variable characterizing the sphere of reference (1 = therapy related, 2 = situations outside of therapy, 3 = reference to therapy and situations outside of therapy, 4 = unclear). In the case of the analyst, 90% of the material referred to situations outside of therapy and less than 1% referred to therapy related issues. In the case of the communicative therapist, 20% of the material focused on the therapeutic situation. Given the focus on the patient-therapist relationship in communicative psychotherapy, this observation is consistent with therapist expectations.

Stiles Verbal Mode Analysis [62–64] could be described as a statement classification method. The unit analyzed is an "utterance" (defined presently). Each unit is coded in to one of eight classes by a sequence of three forced-choice questions. Eight verbal response modes result. The analysis continues with a calculation of the frequency of each class. Verbal Mode Analysis is considered at greater length in the Discussion section of this paper.

Investigators have also examined the narrative speech of clinical populations using symbolic dynamics. In contrast with the research described above, these studies do not examine patient therapist communication. Rather they examine the sequence-sensitive structure of continuous narratives elicited by the question, "Can you tell me the story of your life?" [65, 66] or a narrative produced by a participant in response to a request to recall the content of a story that they have just read [67].

The Leroy, et al. [67] study investigated the sequence-sensitive structure of a recall narrative presented by schizophrenic patients. Following Kintsch and Van Dijk [68, 69], the participant's narrative was treated as a sequence of propositions. The Kintsch and Van Dijk definition of a proposition is the minimal semantic unit that can be either true or false. Propositions were classified as macro-propositions that specify the topic of discourse or micro-propositions that provide details. Macro-propositions were assigned the symbol "M," and micro-propositions were assigned the symbol "m." the narrative sample was thus recast as an ordered sequence of M's and m's. Entropy, Lempel-Ziv complexity and the first order transition matrix were calculated. Comparisons with surrogate data established the presence of a sequence-sensitive non-random structure in the data. The global complexity of recall did not differ for control and schizophrenic participants. There was, however, a difference in the transition structure. There were more micro-propositions to micro-proposition transitions in schizophrenic narratives.

In Doba, et al. [65] autobiographical speech of anorexics was parsed into 5 second epochs. Each epoch was assigned one of four symbols corresponding to negative emotion, positive emotion, neutral emotion and silence. In addition to distribution-determined measures, the Lempel-Ziv complexity and the first order transition matrix were examined. Complexity calculations with surrogate data established the presence of a non-random sequential structure in the narratives. In anorexics, dynamical measures identified recurrent cycles between expressions of negative emotion and silence that were less prominent in the control population. In a subsequent study [66], the same transcripts were analyzed with a different scoring system. Five symbols were used (family relations, social relations, love relations, self-reference and silence). Calculation of mutual information with the original symbol sequences and surrogate data sets again established the presence of a non-random dynamical structure in the narrative. The examination of the summed probability currents, a measure derived from the first order transition matrix, demonstrated that the narratives of anorexics are closer to statistical equilibrium than the narratives of controls.

## Methods

### Patient History

In this study, we describe the analysis of three therapy sessions (each separated by four months) conducted with the same patient (female, 32 years of age) by the same therapist (female). The patient had experienced several traumatic brain injures in a sequence of motor vehicle accidents two years prior to the initiation of therapy. The patient was referred by her psychiatrist for targeted psychotherapy treatment of pre-existing, non-suicidal self-injury and severe emotional dysregulation. Neurological examination established the absence of residual neurological deficits prior to the initiation of therapy. The accident history was, however, deemed to be psychologically significant and had a continuing negative impact on the patient's relationship with her partner. The patient received weekly individual outpatient therapy and group delivered training in behavioral skills. The analyzed sessions were from the individual therapy component. Each session was sixty minutes long. At the time of initiation of treatment the patient met DSM-IV diagnostic criteria for borderline personality disorder. This diagnosis was confirmed with a SCID-II (Structured Clinical Interview for Diagnosis) assessment. The patient was in dialectical behavior therapy following the methods developed by Linehan [70, 71]. Treatment was ongoing between the sessions coded. Institutional Review Board and the participant's informed consent were obtained prior to initiation of the study. Therapy sessions were videotaped for subsequent analysis.

An assessment based on the DSM-IV was repeated at the end of treatment at which time the patient no longer met clinical criteria for a diagnosis of borderline personality disorder. Self report ratings of misery, depressed mood and anxiety were improved. Indices that brought the patient to treatment, frequent suicidal ideation and repeated self-injury, were no longer present and were not present at post-treatment follow-up six months after the termination of therapy.

### Restatement of the Protocol as a Symbol Sequence

There are several possible procedures for parsing a therapy protocol prior to restatement as a symbol sequence. One possibility is to set a fixed time interval and code the content of that interval. This was the procedure followed by Doba, et al. [65, 66] who used 5 second intervals in their analysis of autobiographical speech. While having the advantage of explicit specification, this procedure has the disadvantage of being nonresponsive to the varying pace of natural dialog. We implemented here the more common practice, following Stiles [62–64, 72] of parsing the protocol into natural speech elements. These elements are called utterances in the technical literature. As defined by Stiles, et al. [72] "The coding unit for both forms and intent is the utterance, defined as an independent clause, nonrestrictive dependent clause, multiple predicate, or term of acknowledgment, evaluation or address." A detailed presentation of the definition of an utterance which includes examples is given in Chapter 8 of Stiles' book "Describing Talk" [62].

Protocol Scoring Procedure

Therapist | Patient | Content |
---|---|---|

A | a | Acknowledging |

B | b | Information (Requesting/Providing) |

C | c | Request for Validation |

D | d | Validating |

E | e | Emotional Discharge |

F | f | Complaint |

G | g | Transitional/elicitation |

H | h | Problem Presentation |

I | i | Behavioral Analysis/Educational |

J | j | Reflective |

K | k | Irreverent |

Acknowledging: "Thank you for reminding me of that."

Information (requesting/providing): "I've had that car for two years."

Request for Validation: "Was I wrong to think that way?"

Validating: "Everyone feels that way from time to time."

Emotional Discharge "Never! Never! Never!"

Complaint: "My children never listen to me."

Transitional/Elicitation: "I wanted to remember to tell you about last Saturday."

Problem Presentation: "My husband lost his job."

Behavioral Analysis/Educational: "Do you think he would respond differently if you telephoned first?"

Reflective: "You seem to be saying that you wouldn't like that."

Irreverent "Well he certainly failed that time!"

Symbol Frequency Distribution

Content | Symbol | Frequency All Sessions | First Session | Second Session | Third Session |
---|---|---|---|---|---|

P: Behavioral Analysis/Educational | i | .1184 | .1073 | .1475 | .1010 |

P: Acknowledging | a | .0988 | .0978 | .0947 | .1024 |

T: Acknowledging | A | .0899 | .1041 | .0638 | .1038 |

P: Information (Requesting/Providing) | b | .0830 | .0726 | .0692 | .0982 |

P: Complaint | f | .0798 | .0915 | .0692 | .0827 |

T: Transitional/Elicitation | G | .0766 | .0726 | .0893 | .0687 |

T: Problem Presentation | H | .0735 | .0536 | .0820 | .0757 |

P: Emotional Discharge | e | .0697 | .0820 | .0820 | .0547 |

T: Behavioral Analysis/Educational | I | .0659 | .0820 | .0729 | .0533 |

T: Validating | D | .0532 | .0915 | .0474 | .0407 |

P: Request for Validation | c | .0532 | .0599 | .0455 | .0561 |

T: Reflective | J | .0450 | .0221 | .0492 | .0519 |

P: Problem Presentation | h | .0317 | .0221 | .0346 | .0337 |

T: Information (Requesting/Providing) | B | .0298 | .0221 | .0328 | .0309 |

T: Irreverent | K | .0108 | .0032 | .0000 | .0224 |

P: Transitional/Elicitation | g | .0108 | .0032 | .0182 | .0084 |

P: Validating | d | .0051 | .0126 | .0018 | .0042 |

P: Irreverent | k | .0044 | .0000 | .0000 | .0098 |

T: Request for Validation | C | .0006 | .0000 | .0000 | .0014 |

T: Emotional Discharge | E | .0000 | .0000 | .0000 | .0000 |

T: Complaint | F | .0000 | .0000 | .0000 | .0000 |

P: Reflective | j | .0000 | .0000 | .0000 | .0000 |

The symbol frequency distribution was also calculated for each session with a view to determining if longitudinal changes in symbol frequencies could offer insights into the patient-therapist interaction. We define a consistent change as one in which the frequency of appearance of a symbol either increases or decreases over all three sessions. In the case of the patient, only one variable showed a consistent pattern; the frequency of patient acknowledgments decreased. The decrease from Session 1 to Session 2 was, however, minimal. Otherwise, the only consistent patterns were seen in therapist behavior. The frequency of educational interventions decreased, and the frequency of reflective interventions increased. The frequency of validating interventions from the therapist decreased over the three sessions. This possibly reflects the growing confidence that both participants had in the therapeutic relationship.

Aside from describing predictable changes in therapist behavior, the analysis of symbol frequencies was largely uninformative. This is significant to the present investigation because it suggests the need for measures that quantify sequential behavior.

## Results

### Analysis of Repeated Pairs

High Frequency Repeated Pairs

First Element of Pair | Second Element of Pair | Frequency |
---|---|---|

T: Behavioral Analysis/Educational | P: Acknowledging | .0279 |

T: Problem Presentation | P: Acknowledging | .0260 |

P: Acknowledging | T: Behavioral analysis/Educational | .0247 |

P: Information (Requesting/Providing) | T: Acknowledging | .0241 |

T: Acknowledging | P: Information (Requesting/Providing) | .0234 |

T: Problem Presentation | P: Behavioral Analysis/Educational | .0234 |

P: Emotional Discharge | P: Complaint | .0228 |

T: Transitional/Elicitation | P: Behavioral Analysis/Educational | .0222 |

P: Complaint | T: Acknowledging | .0209 |

### Analysis of Repeated Triples

_{M}there are L

_{M}-2 triples. Nonetheless there, are very few repeated triples in the clinical data. During Visit One nine triples appear more than 1% of the time. During Visit Two only two triples appear in more than 1% of the sample, and in Visit Three, four triples appear at a frequency exceeding 1% (Table 4).

Repeated Triples Appearing at a Frequency Exceeding 1%

Visit One | ||||
---|---|---|---|---|

Triple | Frequency | Content Symbol 1 | Content Symbol 2 | Content Symbol 3 |

cef | .022 | P: Request Validation | P: Emotional Discharge | P: Complaint |

aIa | .019 | P: Acknowledging | T: Behavioral Analysis/Educational | P: Acknowledging |

IaI | .016 | T: Behavioral Analysis/Educational | P: Acknowledging | T: Behavioral Analysis/Educational |

bfA | .016 | P: Information (Requesting/Providing) | P: Complaint | T: Acknowledging |

efc | .013 | P: Emotional Discharge | P: Complaint | P: Request for Validation |

fAb | .013 | P: Complaint | T: Acknowledging | P: Information |

HaI | .013 | T: Problem Presentation | P: Acknowledging | T: Behavioral Analysis/Educational |

bAb | .013 | P: Information (Requesting/Providing) | T: Acknowledging | P: Information (Requesting/Providing) |

fce | .013 | P: Complaint | P: Request Validation | P: Emotional Discharge |

| ||||

Triple | Frequency | Content Symbol 1 | Content Symbol 2 | Content Symbol 3 |

aIa | .015 | P: Acknowledging | T: Behavioral Analysis/Educational | P: Acknowledging |

Iai | .011 | T: Behavioral Analysis/Educational | P: Acknowledging | P: Behavioral Analysis/Educational |

| ||||

Triple | Frequency | Content Symbol 1 | Content Symbol 2 | Content Symbol 3 |

bAb | .018 | P: Information (Requesting/Providing) | T: Acknowledging | P: Information (Requesting/Providing) |

IaI | .017 | T: Behavioral Analysis/Educational | P: Acknowledging | T: Behavioral Analysis/Educational |

AbA | .011 | T: Acknowledging | P: Information (Requesting/Providing) | T: Acknowledging |

aIa | .011 | P: Acknowledging | T: Behavioral Analysis/Educational | P: Acknowledging |

There is a change in the content of repeated triples over the three sessions. In the first session the most frequently observed triple is a request for validation by the patient followed by an emotional discharge followed by a complaint. These three coding elements appear prominently in the other repeated triples observed during the first session. By the second session, which occurred four months after the first session, behavioral analysis by the therapist and acknowledgment of these communications by the patient are the most frequently observed triples. This pattern is consistent with clinical expectations. In the early sessions, the patient-therapist relationship is constructed by the therapist's nonjudgmental acceptance of the patient's complaints, emotional discharges and need for validation. This is particularly true in the course of borderline personality disorder. The work of therapy, implemented by behavioral analysis and education, begins after the construction of the therapeutic alliance.

### Context Free Grammar Complexity

_{1}and M

_{2}.

It should be noted that both messages have the same symbol frequency, eight appearances of each symbol. They are indistinguishable with distribution-determined measures, for example Shannon information, but M_{2} is more complex than M_{1} in our conventional understanding of the term. There are several methods for quantifying the complexity of symbol sequences. A taxonomy of complexity measures has been published [73]. In the first instance, we consider the context free grammar complexity introduced by Jiménez-Montaño [60] (a description is given in Appendix One). Consistent with our qualitative expectations, it is found that that grammar complexity of M_{1} is 20 bits and the complexity of M_{2} is 27 bits.

This result is consistent with the increase in the number of symbols generated in the three sessions (N_{DATA} = 317, 549, 713 respectively). While any observation based on a single case history must be stated circumspectly, the increase in the frequency of subject transition which is reflected in the increase in N_{DATA} over the three sessions is consistent with qualitative clinical observations with borderline patients. As patients progress in therapy one can, in some instances, observe a decreased perseveration in topic and a greater flexibility of discourse. This result is consistent with the quantitative results of McDaniel, et al. [75] who found correlations between rate of improvement and an estimate of the number of patient utterances. The result seen here is also consistent with the Winefield, et al. [76] quantitative characterization of a psychodynamically oriented psychotherapy which showed decreasing asymmetry in patient/therapist verbal behavior during the course of treatment. This decrease in asymmetry was evidenced by increased therapist speech activity. Increased participation by the therapist would result in an increase in patient-to-therapist transitions in the symbol transcript, an increase in N_{DATA}, and an increase in complexity generation.

It is important to make a distinction between the complexity of a message and the intrinsic dynamical complexity of the system that generated the message. The intrinsic complexity of the generator can be estimated by comparing the complexity of the message against the complexity of random messages of equal length generated with the same symbol set. The result is the normalized complexity. Mathematical procedures for constructing this normalization are outlined in Appendix One. The normalized complexity is dimensionless and varies between a value close to zero for a constant symbol sequence (one symbol repeated throughout the entire message) and a value of one for a random sequence. Examples giving intermediate values of normalized complexity are shown in the appendix. The normalized grammar complexity of the three therapy sessions is .765 ± .033, .758 ± .015 and .763 ± .017. There is no significant change in the normalized grammar complexity which suggests that, at least in this therapy, grammar complexity did not detect changes in the underlying dynamical process. The contrast between the consistency of normalized complexity and the increase in complexity per unit time is considered in the Discussion section of this paper.

A comparison of the complexity values obtained with the original therapy symbol sequence and complexity values obtained from random messages of the same length makes it possible to address the following null hypothesis:

As assessed by this complexity measure, the sequential structure of the original message is indistinguishable from the sequential structure of an equi-probable, random sequence of the same length constructed from the same symbol alphabet.

N_{SURR} is the number of comparison random messages (called surrogates) computed. The number of complexity values tested in the numerator includes the complexity of the original symbol sequence as well as the complexity values obtained with surrogates, ensuring that the numerator has a value of at least one. In the calculations in Figures 2 and 3, N_{SURR} = 499 and C_{Surrogate} > C_{ORIG} in all cases. The null hypothesis is rejected with P_{NULL} = .002; that is, the sequential structure of patient-therapist communication in these sessions as scored by this procedure and assessed by this metric is nonrandom.

### Lempel-Ziv Complexity

As before, the surrogate null hypothesis of random structure was rejected by Lempel-Ziv complexity with P_{NULL} = .002 (N_{SURR} = 499) in all cases. It can again be concluded that patient-therapist communication has nonrandom structure.

### Mutual Information

_{1}, A

_{2}, .....A

_{N}) and Message B = (B

_{1}, B

_{2}, .....B

_{N}) constructed from the same alphabet of N

_{α}elements. P

_{A}(I) is the probability of the appearance of Symbol I in Message A P

_{B}(J) is the probability of the appearance of Symbol J in Message B. P

_{AB}(I,J) is the probability that Symbol I appears in Message A and Symbol J appears in Message B at the same time. The average mutual information of Messages A and B is the average number of bits of Message B that can be predicted by measuring Message A. It is denoted by I(A,B). It can be shown [78] that

Mutual information is symmetrical I(A,B) = I(B,A). Also, if two processes are statistically independent then P_{AB}(I,J) = P_{A}(I)P_{B}(J), and I(A,B) = 0. The special case where Message A and Message B are the same, I(A,A), is called self-information.

In this application, we examine the ability of a message to predict its own future. We define I(A_{I},A_{I + 1}) as the mutual information observed when Message A = (A_{1},A_{2},.....A_{N-1}) and Message B = (A_{2},A_{3},.....A_{N}). This can be generalized to consider larger temporal displacements. I(A_{I},A_{I + K}) is calculated by setting Message A = (A_{1},A_{2},.....A_{N-K}) and Message B = (A_{K},A_{K + 1},.....A_{N}). The time shifted self-information is a nonlinear measure of temporal decorrelation. Explanatory examples are given in Cellucci, et al [79]. If a message has strong temporal predictability then I(A_{I},A_{I + K}) remains high as K is increased. If the process generating a message is dynamically disordered, then I(A_{I},A_{I + K}) decreases rapidly as K increases.

Mutual information for the case K = 1 has been applied to the examination of the sequence-sensitive structure of narrative components in the autobiographical speech of anorexic adolescents and controls [66]. These investigators found that I(A_{I},A_{I + 1}) is significantly lower in patients. They also compared I(A_{I},A_{I + 1}) values obtained with their data against the values obtained with random shuffle surrogates and found that surrogates decorrelate faster than the original symbol sequence indicating the presence of non-random structure in the original symbol sequence.

_{I},A

_{I + K}) as a function of the temporal shift parameter K for the three therapy sessions. The mutual information measured in the first session decorrelates more slowly than mutual information obtained with Session Two and Three indicating a higher degree of predictability in Session One. This is consistent with the previous observation of a lower complexity generation rate in Session One. The separation of mutual information functions between the first and second session and the first and third session is significant (P < 10

^{-7}). This significance is computed by comparing twenty five values of mutual information (shift parameter K = 0 to 24) in a paired t-test. The mutual information values obtained in Sessions Two and Three are indistinguishable. This indicates that the process detected by longitudinal measurement of mutual information has stabilized by Session Two or that this measure is insufficiently sensitive to detect a continuing process altering patient-therapist communication.

_{AB}(i,j) = P

_{A}(i)P

_{B}(j) and I(A,B) = 0. It is possible to compute the probability of the null hypothesis of statistical independence. Let E

_{AB}(i,j) be the expected number of (i,j) symbol pairs given the assumption of statistical independence.

_{α}is the number of symbols in the alphabet. The number of degrees of freedom is ν = (N

_{α}- 1)

^{2}. The probability of the null hypothesis is

where Q is the incomplete gamma function.

When this analysis is applied to the symbol sequences generated by the three therapy sessions, the null hypothesis is rejected by construction for K = 0 but also for K = 1 for the three sessions. This result indicates the absence of predictive structures beyond the first symbol iteration, which is consistent with the results obtained with first order Markov surrogates in a later section of this paper.

### N^{th}-Order Entropy and Conditional Entropy

_{n}, is given by

_{max}is the number of possible n-words. N

_{max}will be a function of the size of the alphabet N

_{α}. In the absence of a priori rules restricting allowable n-words N

_{max}= (N

_{α})

^{n}. The sum takes place over all substrings where . H

_{n}quantifies the average amount of information contained in a substring of length n, and therefore is monotone increasing in n. The related conditional entropies, h

_{n}, are given by

h_{n} is the average amount of information needed to predict the next symbol in a substring if the first n symbols are known, giving h_{n} ≥ h_{n + 1}.

_{n}and h

_{n}as a function of order n for the three therapy sessions are shown in Figure 8. At each order, the values of H

_{n}obtained in the third session are greater than the values obtained in the second session which are greater than the values obtained in the first session. This result is consistent with the previously presented rate of complexity generation (Session 3 > Session 2 > Session 1) and with the observation that mutual information, which is related to entropy, decorrelates faster in the later sessions. The between-session separation of conditional entropy is less marked, but the conditional entropy of Session 3 is greater than that of Session 1 at all orders of n.

_{n}as n increases, if one uses the equation for H

_{n}given above. A message of N symbols contains N-(n-1) n-words. As previously noted the number of possible n-words in the absence of restrictive rules is (N

_{α})

^{n}. Thus the number of possible n-words increases exponentially with order n, while the number of words actually present is limited by N. Let be the expectation value of the number of appearances of the i-th n-word for the case of an equiprobable distribution.

The calculation of H_{n} using the previous equation is warranted in the case of good statistics which is obtained when
is on the order of ten [87]. In the present analysis N_{α} = 22, and the smallest value of N is obtained in Session 1 where N = 317. The criterion
is satisfied for n = 1 where H_{n} for Session 1 < Session 2 < Session 3, but fails for n ≥ 2.

_{n}quickly approaches its limiting N-determined value as n increases. For a symbol sequence generated by the logistic equation near the Feigenbaum point, H

_{n}≈ log

_{2}N, for large n where N is the length of the symbol sequence [88, 89]. The same relationship is obtained with the computationally generated rabbit sequence [90]. These are highly disordered symbol sequences generated by deterministic processes. This argument can be generalized [87]. Recall that the number of possible words increases exponentially with n and is limited by N. To an approximation of the limiting case for large n, any given word is either absent or appears only once. In this case, there are N - (n - 1) ≈ N words with probability , and all others have . A series expansion can be used to show that . Therefore the limiting case of H

_{n}for large n is

In the case of the three therapy sessions, N = 317, 549 and 713 giving value of log_{2} N of 8.308, 9.101 and 9.478. The corresponding values of H_{5} are 8.225, 9.057 and 9.421. This suggests that the between-session differences in entropy as computed here simply reflects the increase in N over the three sessions.

Recognition of these issues has motivated the search for improved procedures for estimating H_{n} when n is large and N is small. Several investigators have addressed this problem [88, 91–97]. We have implemented on of these procedures [88] and applied it to the therapy data. As expected by the failure to satisfy the
criterion, no between-session separation was observed for higher values of n. These results are consistent with the conclusions of Lesne, et al. [97] who recommended using Lempel-Ziv complexity as the more reliable measure of structure when short symbol sequences are analyzed.

### Markov Surrogates

Let P_{IJ} be the probability that Symbol I is followed by Symbol J. These probabilities are summarized in the first order transition matrix [P_{IJ}]. A first order Markov surrogate is a symbol sequence constructed by a constrained randomization that has the same length and same [P_{IJ}] as the original symbol sequence. A comparison of complexity values obtained with Markov surrogates and the complexity of the original symbol sequence can be used to address the following null hypothesis:

As assessed by this measure, the sequential structure of the original message is indistinguishable from the sequential structure of a random process that has the same length and first order transition matrix as the original message.

Calculations with Markov surrogates follow the same pattern as calculations with equi-probable surrogates. C_{ORIG} is determined, surrogates are constructed (in this case first order Markov surrogates), and values of C_{Surrogate} are calculated. The probability of the null hypothesis is calculated using the previous formula and these values of C_{ORIG} and C_{Surrogate}. With these data and these complexity measures, there is a failure to reject the null hypothesis for all three sessions. The average value of P_{NULL}obtained with the context free grammar complexity and 499 equi-probable surrogates was .935 and the average value obtained with Lempel-Ziv complexity was .617. This means that with these data and these measures of complexity, a therapy session's symbol sequence is indistinguishable from a random process with the same first order transition matrix. This does not mean that a higher order structure is not present in the sequence. Rather, the results show that these measures failed to find evidence for that structure. Theoretically, the null hypothesis could be rejected with these data and a different measure.

## Discussion

This is a case study, and therefore any results must be regarded as inconclusive until confirmed by a more systematic investigation. In this therapy the rate of complexity generation increased across the three sessions investigated. This increase in variability is consistent with the statistically significant faster decorrelation time observed in the K = 1 mutual information calculation and in the increase in n-th order entropy and conditional entropy for n = 1. It is also consistent with the clinically observed changes in the flexibility of patient communication during the course of treatment. Additionally, using two measures of complexity we have demonstrated that the sequential structure of patient-therapist dialog in these sessions has a nonrandom structure (P_{NULL} = .002). These results are consistent with results of previous investigations summarized by Leroy, et al. [57]:

- "(1)
temporal organization is a significant feature of speech,

- (2)
counting (by which they mean the sequence-independent, distribution-determined frequencies of content elements) is not sufficient for an adequate characterization of language, and

- (3)
symbolic dynamical methods are needed for the sake of completeness"

As previously noted, the contrast between the consistency of normalized complexity (both Lempel-Ziv and context free grammar complexity) over the three sessions and the increase in complexity generation (complexity per unit time) requires examination. Possible insights into this question can be gained by examining the quantitative literature investigating hierarchical structures in language [98–101]. Based on this research we wish to suggest that the normalized complexity quantifies an invariant structure intrinsic to language when characterized by this form of symbolic restatement, while complexity per unit time quantifies pragmatic language use. Some measure of support for this hypothesis can be obtained by consideration of work by Montemurro and Zanette [102]. Montemurro and Zanette examined the sequential structure of word ordering in 7,097 texts drawn from eight languages (English, French, German, Finnish, Tagalog, Summarian, Old Egyptian and Chinese). They computed a measure of entropy based on Lempel-Ziv complexity and a normalized relative entropy based on comparisons with randomly shuffled sequences of equal length. They found that "while a direct estimation of the overall entropy of language yielded values that varied for the different families considered, the relative entropy quantifying word ordering presented an almost constant value for all these families. ... Therefore our evidence suggests that quantitative effects of word order correlations on the entropy of language emerges as a universal statistical feature." The Montemurro and Zanette study examined the sequential structure of word ordering. It is recognized that word ordering is not identical to the concept sequencing uncovered by the symbolic coding process used in our study, but the presence of near constant normalized complexity in the presence of a highly variable complexity offers support, albeit indirect support, for our hypothesis of a dissociation between pragmatic complexity (bits/minute) and intrinsic structure (normalized complexity). This is a case study of a single patient. Any further speculation must be deferred until additional data are available.

A systematic research effort will be required to address the other questions raised in the introduction to this paper. In addition to acquisition of longitudinal data obtained from a large, clinically homogeneous population, the introduction of additional measures of sequential structure can be considered. The inverted-U measures of complexity [103] are theoretically important but have received little application with observational data (as distinct from computationally generated symbol sequences). These measures of complexity give low values for both highly regular sequences and for random sequences but high values for chaotic sequences (where the word chaos is being used here in the technical sense). This is an interesting possibility since it has been suggested that patient-therapist communication can be chaotic [104–109]. More general reviews of dynamical metaphors in psychopathology and psychotherapy are given in [110–113].

An analysis of the computational results identified the limitations of the approach taken in this paper. The large number of symbols in the alphabet and the comparatively short message lengths severely limit the kinds of analyses that can be applied. An alternative approach can be implemented using Stiles' Verbal Mode Analysis. In this analysis, each utterance is scored by three forced choice questions called principles of classification (source of experience, frame of reference, and presumption). These three binary scores are used to specify one of eight mutually exclusive categories. The eight celled classification process is applied to each utterance twice. The first classification is determined by grammatical form. The second is based on pragmatic intent. Several analysis options are thus available. The sequential structure of the form (grammatical) coding and the intent (pragmatic) coding can be analyzed separately. In these cases, N_{α} = 8. At a finer scale, the three principles of classification each generate a binary sequence, N_{α} = 2 that can be examined. These scoring methodologies make it possible to perform mathematical analyses that are not feasible for large N_{α}. The analyses of ordered triples reported here does, however, indicate that the rich content introduced by a large N_{α} can reveal important insights into the evolving dynamic of patient-therapist communication. In the ideal case, protocols can be scored by more than one procedure and analyses performed with the widest possible collection of mathematical methods.

Psychotherapy, even when the treatment is concretized in treatment manuals is, by nature, transactional, flexible and often highly individualized. As such, the field of psychotherapy research standardly employs a 'technology model' [114] in conducting treatment development and evaluation research. Psychotherapy process researchers also employ a methodology for measuring complex, deterministic, and dynamic processes within the therapy experience. Core to both models is the application of highly specified behavioral coding systems to recoded samples of therapy sessions. A discussion of this literature is beyond the scope of the current article. Also, it should be noted that our experience suggests that the procedures presented here are not only generically applicable to the field of psychotherapy research but are also of value in training therapists. The discipline of examining each verbal exchange at this level of detail and the process of identifying recurring patterns of communication (the words change, but the symbol sequence recurs) helps trainees to identify maladaptive communication strategies and encourages them to view a therapy not as separated exchanges but as a larger scale dynamical process. Independently of the subsequent mathematical analysis, the process of sequential symbolic transcription is a valuable exercise. Additionally, these methods may be of particular value in the examination of therapies following traumatic brain injury. These therapies can, in some instances, be complicated by cognitive deficits that result in distortions of language. As noted by Granacher [115] a distinction is to be made in the language deficits following traumatic brain injury between deficits of speech (the mechanical articulation of language) and deficits in the use of language (generation and comprehension of syntactic and semantic structure) which can be investigated using the methods tested here. In the case of injuries, frank aphasias can result. Their identification does not require sophisticated mathematical analysis. These aphasias typically resolve spontaneously into mild residual anomia [116, 117]. In other cases, however, subtle distortions of language can occur after traumatic brain injury. "The basic structural components of language may be intact but the ability to use language to engage socially is impaired." [117] Deficits in the effective use of language following traumatic brain injury have been reviewed by Coelho [118] and by Coelho and Youse [119]. In addition to complicating therapy, these deficits can have a significant negative impact on post-injury quality of life. These deficiencies in language are commonly described as deficits in pragmatic competence where, as used here, the word pragmatics is defined as the subfield of linguistics which investigates the way in which context contributes to meaning [120, 121]. These deficits are not typically expressed as failures to comprehend single sentences but are observed as failures to understand sequence-dependent, multi-sentence discourse [122]. Sohlberg and Mateer [117] have provided the following summary:

"Pragmatics constitute a comprehensive set of skills required for competence in naturalistic, functional use of language. The term can be broadly defined as the use of language for communication in specific contexts [123]. Pragmatics behaviors transcend isolated word and grammatical structures; they make up the system of rules clarifying the use of language in terms of situational or social contexts. People with brain injury often demonstrate normal basic linguistic skills, but have difficult adapting their communication to specific contexts; for example they may exhibit tangential speech, poor verbal organization, or inadequate turn taking [124]."

Pragmatic deficits are not limited to traumatic brain injury but are also observed in autism [125, 126], attention deficit hyperactivity disorder [127] and schizophrenia [128, 129]. In contrast with these disorders, the presentation of deficits in pragmatic competence following traumatic brain injury is complicated by acute onset followed by a complicated post-injury time course that can result from progressive cognitive loss or improvement due to spontaneous resolution. Highly variable day to day changes in competence can also sometimes be observed.

As reviewed by Martin and McDonald [121], three theories presenting explanations for deficits in pragmatic competence following traumatic brain injury are now under consideration: Social Inference Theory, Weak Central Coherence and Executive Dysfunction. Social Inference Theory argues that pragmatic failures follow from failures of the patient's Theory of Mind. An individual's Theory of Mind is "the capacity to infer mental states of others ... a person's ability to form representations of other people's mental states and to use the representations to understand, predict and judge utterances and behaviors" [130]. Following initial work by Santoro and Spiers [131], a rapidly growing literature has documented Theory of Mind deficits following traumatic brain injury [132–136]. Weak Central Coherence results in an individual's focus on components and a failure to integrate components into larger scale coherent structures. In addition to being a possible cause of post-injury pragmatic deficits, weak central coherence may be present in autistic patients [137–139]. The Executive Function system controls and regulates other processes and is particularly important in responding to novel situations requiring planning and decision making. Executive functions are localized in the prefrontal cortex [140, 141], and injury to the prefrontal cortex can cause executive dysfunction which in turn results in deficits in language. Significant correlations between executive function and pragmatic communication difficulties following traumatic brain injury have been reported [142].

While arguments can be made that deficits in any of these capabilities (Theory of Mind, Central Coherence, and Executive Function) can result in pragmatic language deficits, there is no present evidence indicating which of the three is predominant in pragmatic deficits following traumatic brain injury. Indeed, several investigators have results indicating that it is very difficult to ascribe observed deficits to any given cause [143–146]. Given the heterogeneity of the traumatic brain injury population, it seems probable that pragmatic failures will have different causes in different patients.

Irrespective of the cause, psychotherapists of traumatic brain injury patients must be sensitive to the possible impact of erratically varying language competence in patient-therapist communication. As outlined in Sohlberg and Mateer [117] none of the currently available procedures for assessing pragmatics following brain injury are completely satisfactory. The methods closest to the procedures developed here are conversational analysis studies of language following traumatic brain injury [147–151]. The analysis employed by Snow, et al. [147] was modified from Damico's Clinical Discourse Method [152, 153]. Seventeen parameters were organized into four groups (Quantity, Quality, Relation, and Manner). A similar study published by Friedland and Miller [149] scored natural conversations in four areas (Repair, Silences, Minimal Turns, Topic). In a study of conversational structure, Coelho, et al. [151] found differences in the flow of conversation of traumatic brain injury patients when compared to healthy controls. They found that patients were more dependent on the investigator to maintain the interaction. Individuals with traumatic brain injury did not initiate and appeared to function primarily as responders. The sequential structure of discourse is not, however, quantified by these methods. It can be noted, however, that it may be possible to apply the sequence sensitive measures presented here to these previous analyses. For example, in the Coelho, et al. [151], study two categories of analysis were applied, Appropriateness and Topic Initiation. The Appropriateness of an utterance was assigned to one of four categories (Obliges, Comments, Adequate Responses, Adequate Plus Responses). The results were reported as between-group means and standard deviations. Significant differences were seen in two of the four categories. This analysis can be viewed as a restatement of the conversation as an eight-symbol alphabet (four Appropriateness categories crossed against Investigator or Patient). The sequential structure of this symbol sequence can be quantified.

How might deficits in pragmatic competence following traumatic brain injury be reflected in complexity and entropy measurements of patient-therapist communication? Deficits in pragmatics are reflected in sequential structures including poor organization, tangential speech and loss of coherence. As documented by Chapman [154, 155] some patients will present a loss, possibly a subtle loss, of coherence in verbal production. This loss of coherent structure would be reflected in an increase in complexity and entropy, a more uniform symbol frequency distribution and a broader spectrum of repeated pairs. Conversely, perseverations of discourse and topic repetitiveness, which can also be observed following brain injury [156], would result in a decrease in complexity and entropy. Pragmatics deficits would therefore be expected to produce bimodally distributed values of sequence sensitive measures. Further research may show that a high degree of variability in complexity within sessions and between sessions is diagnostic of failures of pragmatic competence in traumatic brain injury patients.

The present results suggest that dynamical measures can be used longitudinally to follow the course of treatment. To a degree, it is possible to consider two distinct processes occurring during the course of psychotherapy following a brain injury: psychological change reflecting emotional development and cognitive change having an impact on language due to organic changes in the central nervous system (recovery or continuing deterioration). The longitudinal application of the measures developed here may provide a means of separating and observing these processes quantitatively. Psychological change may be reflected in changes in subject content while cognitive changes may result in changes of linguistic structures that can be captured by complexity measures.

## Conclusions

We join with Morris and Bleiberg [157] in arguing that psychotherapy should be integrated with cognitive rehabilitation in the treatment of brain injury patients. We also agree with Judd and Wilson [158] in concluding that modifications of psychotherapy will often be required when working with these patients. The diversity of the traumatic brain injury population makes it impossible to construct a single, generic therapy for these patients. Any conclusions based on the quantitative analyses of protocols from a single patient are clearly provisional. It is suggested, however, that with further development and larger studies, the methods developed here for the quantitative analysis of dynamical structures in patient-therapist communication may become useful on a patient-by-patient basis to inform these clinical decisions.

## Appendix One. Context Free Grammar Complexity

Classically complexity is defined as the amount of information required to specify the contents of a message [84, 159, 160]. An historical review is given in Li and Vitányi [[161] Section 1.6]. This definition can be operationalized by building an instruction set that can generate the message. The complexity of the message is defined to be the length of the instruction set. This operationalization is implemented in the context free grammar complexity [60, 162]. A systematic procedure (outlined below) is used to construct an algorithm that can reconstruct the original message. The size of the algorithm (also defined below) is the complexity of the message. It is understood that this gives an upper bound to complexity. It is always possible that an alternative construction will give a smaller instruction set. This is true of all complexity measures in this category (randomness finding, nonprobabilistic, model based, [73]). Because the procedure used to construct the algorithm is systematic, complexity is valid as a comparative measure. This consideration also indicates why it is useful to have the results of a complexity analysis confirmed by the application of a second measure. "There is no single value of complexity. These calculations provide a systematic procedure for obtaining an empirical measure of dynamical behavior that can be compared across conditions." [163].

_{2}.

There are no other repeated triples. In the general case, the search for repeated triples is following by a sequential search for repeated n-tuples, n = 4, 5, 6.... until the search is exhausted. In the case of this message there are no higher order repeats. The compression has converged.

^{2}. CCC is replaced by C

^{3}and BB is replaced by B

^{2}. The instruction set to reconstruct the original message is:

The total is 27.585. Again under this definition, the integer part of the final sum is reported in bits. The context free grammar complexity of M_{2} is 27 bits.

_{ORIG}is approximated by finding the difference in complexity values obtained in the first half and the second half of the message and expressing this difference as a fraction of their average value. Let C

_{A}be the complexity of the first half of the message. Let C

_{B}be the complexity of the second half of the message. Under this approximation, the uncertainty in C

_{ORIG}is given by

where we use the property C_{A} and C_{B} are positive.

_{A}= C

_{B}. An alternative procedure for estimating ΔC

_{ORIG}can be constructed by calculating <C

_{1/2}>, the mean value of complexity calculated from all possible substrings of length L

_{M}/2, and σ

_{1/2}the standard deviation of that mean. Expressed as a fraction, uncertainty is σ

_{1/2}/<C

_{1/2}>, and ΔC

_{ORIG}is given by

This procedure is, however, computationally insupportable for longer messages. Suppose L_{M} = 8000. This procedure for estimating <C_{1/2}> would require averaging 4000 values of complexity calculated from strings of length L_{M}/2 = 4000. We have adopted the procedure of calculating <C_{1/2}> from 100 strings of length L_{M}/2. They are selected randomly from the set of all possible L_{M}/2 substrings. In cases where L_{M} < 200, <C_{1/2}> is calculated from all possible substrings of length L_{M}/2.

_{ORIG}and the intrinsic complexity of the process that generated the message. The value of grammar complexity will depend on two factors, the complexity of the dynamical process generating the symbol sequence and the length of the symbol sequence. This is seen in the upper panel of Figure 11 where grammar complexity is plotted as a function of the length of the data set. The ordering of complexity values seen with 1000 element sequences in Figure 2 is preserved (random > Hénon > Lorenz > Rössler > constant) and the values increase with the size of the data set. It is therefore necessary to find an effective normalization of complexity values that allows comparison of intrinsic complexities without the complication of data set size.

_{ORIG}by the length of the message is an acceptable solution. It has been shown that this is not the case [169]. An effective normalization of C

_{ORIG}can be achieved by comparing it against the values of complexity obtained from random equiprobable messages of the same length. Let N

_{α}be the size of the symbol alphabet (the number of distinct symbols available for message construction, in these examples N

_{α}= 2). N

_{α}is not message length L

_{M}. An equiprobable surrogate is one where each symbol appears with probability 1/N

_{α}. Let <C

_{S}> denote the average value of complexity obtained from random equiprobable surrogates of length L

_{M}(the subscript s denotes a surrogate). The normalized complexity is defined by

C_{N} ranges from close to zero for messages containing a single repeated symbol to close to one for messages generated by random processes.

As outlined in Rapp [170], C_{N} cannot be formed by normalizing against random shuffle surrogates. Consider the case of a message that consists of a single repeated symbol selected from an alphabet of size N_{α} > 1. (Sequences in a message space of N_{α} = 1 consist of a single symbol and only differ by length. Trivially, their complexity is the number of bits required to encode length L_{M}.) An effective normalization should give a low value of C_{N} to a repeated symbol message. Suppose surrogates were formed by a random shuffle. Since the message contains only one symbol, they all have the same value of complexity. In this case, C_{ORIG} = <C_{S}> and hence C_{N} = 1, which is the complexity of a random message. If instead surrogates are equiprobable on N_{α}, N_{α} > 1, then <C_{S}> is greater than C_{ORIG} and C_{N} has a low value. A low value of complexity is expected for a constant sequence.

The estimation of ΔC_{ORIG} has been discussed. <C_{S}> is the mean complexity computed from a distribution of equiprobable surrogates. Δ<C_{S}> is the standard deviation of that distribution.

Comparison of C_{ORIG} and the complexity values obtained with surrogates makes it possible to address the following surrogate null hypothesis:

As assessed by this complexity measure, the sequential structure of the original message is indistinguishable from the sequential structure of an equi-probable, random sequence of the same length constructed from the same symbol alphabet.

N_{SURR} is the number of surrogates computed. The number of complexity values tested in the numerator includes the complexity of the original symbol sequence as well as the complexity values obtained with surrogates, ensuring that the numerator has a value of at least one. This statistical test was chosen because it is a distribution-agnostic test, that is, it makes no assumptions about the structure of the C_{Surrogate} distribution. Surrogates have a random structure, and the grammar complexity gives the highest value to random sequences. We therefore expect the values of C_{Surrogate} to be greater than the value of C_{ORIG} if a nonrandom structure is present in the original sequence. The smallest value of P_{NULL} will be obtained when all values of C_{Surrogate} are greater than C_{ORIG}. That minimum value is therefore 1/(1 + N_{SURR}). In the calculations in Figures 10 and 11, N_{SURR} = 499 and C_{Surrogate} > C_{ORIG} in all cases for the constant sequence, Rössler, Lorenz and Hénon data. The null hypothesis is therefore rejected with P_{NULL} = .002. As expected, the null hypothesis is not rejected by symbol sequences produced by a random number generator. For the ten cases in Figure 11 corresponding to L_{M} = 1000, 2000, ... 10,000, the average value of P_{NULL} obtained with random data is P_{NULL} = .562

Barnard [171] and Hope [172] have proposed a nonparametric test for rejecting the null hypothesis. Under their criterion the null hypothesis is rejected if C_{ORIG} < C_{Surrogate} for all of the surrogates. If this criterion is met, as it is in these calculations, the probability of the null hypothesis is again P_{NULL} = 1/(1 + N_{SURR}).

As outlined in Watanabe, et al. [163] reported values of complexity obtained with real variable data requires the specification of:

1. the complexity measure used,

2. the number of symbols in the alphabet,

3. the procedure used to partition values onto the symbol set,

4. the procedure used to generate the surrogates used to calculate C_{N},

5. the number of surrogates used, and

6. the statistical procedure used to calculate the probability of the surrogate null hypothesis.

## Appendix Two. Lempel-Ziv Complexity

_{M}. The vocabulary of a symbol sequence, denoted by v{M}, is the set of distinct subsequences that can be found in the message. By definition, a message is an element of its own vocabulary. If, for example, M = 00101, then:

A message can be expressed as a concatenation of substrings. Thus M = 000110100 is equivalent to M = X_{1}X_{2}X_{3}X_{4}, where X_{1} = 0, X_{2} = 001, X_{3} = 10, and X_{4} = 100. An additional element of notation is required. For any message M, the message MM_{π} is the identical message following deletion of the last symbol. M_{π} therefore has length L_{M}-1. This deletion operation can be combined with concatenation. If X_{1} = 001 and X_{2} = 011, then (X_{1}X_{2})_{π} = 00101.

For any symbol sequence of length L_{M} ≥ 3, more than one decomposition into substrings is possible. The Lempel-Ziv algorithm [77] prescribes a procedure for decomposing a message into a concatenation of substrings. Only one decomposition is consistent with the algorithm. The Lempel-Ziv complexity is defined as the number of subsequences produced by this decomposition. In a Lempel-Ziv decomposition, the first subsequence consists of the first symbol only. Subsequence X_{2} begins at the second symbol. Symbols are added to this subsequence until X_{2} is no longer an element of the vocabulary v{(X_{1}X_{2})_{π}}. When this occurs, X_{2} is complete, and the construction of X_{3} begins. Consecutive symbols are added to X_{3} until X_{3} ∉ v{(X_{1}X_{2}X_{3})_{π}}. The construction of X_{4} then begins. This procedure continues until the entire message is expressed as a concatenation of N subsequences, M = X_{1}X_{2} ......X_{N}. The Lempel-Ziv complexity is the integer N, C_{LZ} = N.

_{1}X

_{2}X

_{3}X

_{4}and C

_{LZ}= 4. On reflection it can be seen that this decomposition will provide a mechanism for compressing messages. For any J, by construction subsequence (X

_{J})

_{π}appears somewhere earlier in the message. X

_{J}can therefore be completely specified by three quantities:

- 1.
the index of the position earlier in the message where (X

_{J})_{π}begins, - 2.
the length of X

_{J}, and - 3.
the identity of the last symbol of X

_{J}.

When very large messages are analyzed, X_{J} can be very long, perhaps thousands of symbols. This very long substring can now be replaced by these three quantities. Additional examples and pseudo-code for calculating the Lempel-Ziv complexity are given in Appendix A of Watanabe, et al. [163].

_{M}. In these calculations, 499 surrogates were computed and the null hypothesis was rejected with probability P

_{NIULL}= .002 in all cases with the exception of random data where the average value of P

_{NIULL}was .450.

As previously reported [169] grammar complexity and Lempel-Ziv complexity are highly correlated. The complexity values computed with Rössler, Lorenz, Hénon and random data for L_{M} = 1000, 2000, .... 10,000 element data sets were compared. The Pearson linear correlation coefficient was found to be r = .998 (the same value that was obtained with different data in [169]). The probability of the null hypothesis of no correlation was less than 10^{-8}.

## Appendix Three: Specification of Model System

The random number generator [179] produced uniformly distributed random numbers on [0,1]. It is based on L'Ecuyer's two-sequence generator [180] and incorporates a Bays-Durham shuffle [181].

## Declarations

### Acknowledgements

PER would like to acknowledge training received at the Philadelphia School of Psychoanalysis and the Philadelphia Consultation Center and specifically Dr. Stephen Day Ellis, President, and Dr. Angela Sandone-Barr, Director of Clinical Services. Discussions with Dr. Arnold Feldman and with the members of the Entwurf Gruppe are acknowledged with gratitude. The opinions and assertions contained herein are the private opinions of the authors and are not to be construed as official or reflecting the views of the United States Department of Defense. MAJM acknowledges partial support from: Sistema Nacional de Investigadores; PROMEP, Project: UV-CA-197 MEXICO, and Universidad Veracruzana. PER would like to acknowledge support from the Traumatic Injury Research Program of the Uniformed Services University of the Health Sciences and from the Defense Medical Research and Development Program.

## Authors’ Affiliations

## References

- Hibbard MR, Uysal S, Kepler K, Bogdany J, Silver J: Axis I. psychopathology in individuals with traumatic brain injury. Journal of Head Trauma Rehabilitation. 1998, 13: 24-39. 10.1097/00001199-199808000-00003.PubMedGoogle Scholar
- Hibbard MR, Gordon WA, Othera LM: Traumatic brain injury. Cognitive-Behavioral Strategies in Crisis Intervention. Edited by: Dattilo FM, Freedman A. 2000, New York: Guilford Press, 219-242.Google Scholar
- National Institutes of Health: Rehabilitation of persons with traumatic brain injury. NIH Consensus Statement. 1998, 16 (1): 26-28. OctoberGoogle Scholar
- Zaloshnja E, Miller T, Langlois J, Selassie A: Prevalence of long-term disability from traumatic brain injury in the civilian population of the United States, 2005. Journal of Head Trauma Rehabilitation. 2008, 23 (6): 394-400. 10.1097/01.HTR.0000341435.52004.ac.PubMedGoogle Scholar
- Fann JR, Katon WJ, Uomoto JM, Esselman PC: Psychiatric disorders and functional disability in out-patients with traumatic brain injuries. American Journal of Psychiatry. 1995, 152 (10): 1493-1499.PubMedGoogle Scholar
- Van Reekum R, Bolago I, Finlayson MS, Garner A, Links PS: Psychiatric disorders after traumatic brain injury. Brain Injury. 1996, 10: 319-327. 10.1080/026990596124340.PubMedGoogle Scholar
- Ashman TA, Spielman SA, Hibbard MR, Silver JM, Chandna T, Gordon WA: Psychiatric challenges in the first 6 years after traumatic brain injury: cross-sequential analyses of Axis I disorders. Archives of Physical Medicine and Rehabilitation. 2004, 85 (Supplement 2): S36-S42.PubMedGoogle Scholar
- Deb S, Lyons I, Koutzouskis C, Ali K, McCarthy G: Rate of psychiatric illness 1 year after traumatic brain injury. American Journal of Psychiatry. 1999, 156: 374-378.PubMedGoogle Scholar
- Rosenthal M, Christensen BK, Ross TP: Depression following traumatic brain injury. Archives of Physical Medicine and Rehabilitation. 1998, 79: 90-103. 10.1016/S0003-9993(98)90215-5.PubMedGoogle Scholar
- Iverson GL: Misdiagnosis of persistent postconcussion syndrome in patients with depression. Archives of Clinical Neuropsychology. 2006, 21: 303-310. 10.1016/j.acn.2005.12.008.PubMedGoogle Scholar
- Cope DN: An integration of psychopharmacological and rehabilitation approaches to traumatic brain injury rehabilitation. Journal of Head Trauma Rehabilitation. 1994, 9: 1-18.Google Scholar
- Prigatano GP: Disordered mind, wounded soul: the emerging role of psychotherapy in rehabilitation after brain injury. Journal of Head Trauma Rehabilitation. 1991, 6 (4): 1-10. 10.1097/00001199-199112000-00004.Google Scholar
- Ben-Yishay Y, Rattok J, Lakin P, Piasetsky EB, Ross B, Silver S, Zide E, Ezrachi O: Neuropsychologic rehabilitation: Quest for a holistic approach. Seminars in Neurology. 1985, 5 (3): 252-258. 10.1055/s-2008-1041522.Google Scholar
- Ezrachi O, Ben-Yishay Y, Kay T, DiUer L, Rattok J: Predicting employment in traumatic brain injury following neuropsychological rehabilitation. Journal of Head Trauma Rehabilitation. 1991, 6 (3): 71-84. 10.1097/00001199-199109000-00010.Google Scholar
- Teri L, Logsdon RG, Uomoto J, McCurry SM: Behavioral treatment of depression in dementia patients: a controlled clinical trial. Journal of Gerontology B. Psychological Sciences. 1997, 52B: 159-166. 10.1093/geronb/52B.4.P159.Google Scholar
- Goranson TE, Grave RE, Allison D, La Frenieres R: Community integration following multidisciplinary rehabilitation for traumatic brain injury. Brain Injury. 2003, 17: 759-774. 10.1080/0269905031000088513.PubMedGoogle Scholar
- Williams WH, Evans JJ, Wilson BA: Neurorehabilitaton for two cases of post-traumatic stress disorder following brain injury. Cognitive Neuropsychiatry. 2003, 8: 1-18. 10.1080/713752238.PubMedGoogle Scholar
- Tiersky LA, Anselmi V, Johnston MV, Kurtyka J, Rosen E, Schwartz T, DeLuca J: A trial of neuropsychologic rehabilitation in mild-spectrum traumatic brain injury. Archives of Physical Medicine and Rehabilitation. 2005, 86 (8): 1565-1574. 10.1016/j.apmr.2005.03.013.PubMedGoogle Scholar
- Beutler LE, Moleiro C, Talebi H: How practitioners can systematically use empirical evidence in treatment selection. Journal of Clinical Psychology. 2002, 58: 1199-1212. 10.1002/jclp.10106.PubMedGoogle Scholar
- Payne HC: Traumatic brain injury, depression and cannabis use-assessing their effects on cognitive performance. Brain Injury. 2000, 15: 479-489.Google Scholar
- Medd J, Tate RL: Evaluation of an anger management programme following acquired brain injury: a preliminary study. Neuropsychological Rehabilitation. 2000, 10 (2): 185-201. 10.1080/096020100389246.Google Scholar
- Sohlberg MM: Psychotherapy approaches. Neuropsychological Management of Mild Traumatic Brain Injury. Edited by: Raskin SA, Mateer CA. 2000, New York: Oxford University Press, 137-156.Google Scholar
- Cicerone K: Psychotherapeutic interventions with traumatically brain-injured patients. Rehabilitation Psychology. 1989, 34: 105-114.Google Scholar
- Ruff RM, Camenzuli L, Mueller J: Miserable minority: emotional risk factors that influence the outcome of a mild traumatic brain injury. Brain Injury. 1996, 10 (8): 551-566. 10.1080/026990596124124.PubMedGoogle Scholar
- Anson K, Ponsford J: Evaluation of a coping skills group following traumatic brain injury. Brain Injury. 2006, 20: 167-178. 10.1080/02699050500442956.PubMedGoogle Scholar
- Mateer CA, Sira CS: Cognitive and emotional consequences of TBI: intervention strategies for vocational rehabilitation. Neurorehabilitation. 2006, 21: 315-326.PubMedGoogle Scholar
- Lewis L, Rosenberg SJ: Psychoanalytic psychotherapy with brain-injured adult psychiatric patients. Journal of Nervous and Mental Disease. 1990, 178 (2): 69-77. 10.1097/00005053-199002000-00001.PubMedGoogle Scholar
- Goldstein K: The effects of brain damage on the personality. Psychiatry. 1952, 15: 245-260.PubMedGoogle Scholar
- Folzer SM: Psychotherapy with "mild" brain-injured patients. American Journal of Orthopsychiatry. 2001, 71 (2): 245-251.PubMedGoogle Scholar
- Werman DS: The Practice of Supportive Psychotherapy. 1988, New York: Brunner/MazelGoogle Scholar
- Prigatano GP, Klonoff PS: Psychotherapy and neuropsychological assessment after brain injury. Journal of Head Trauma Rehabilitation. 1988, 3: 45-68.Google Scholar
- Delmonico RL, Hanley-Peterson P, Englander JC: Group psychotherapy for persons with traumatic brain injury: Management of frustration and substance abuse. Journal of Head Trauma Rehabilitation. 1998, 13 (6): 10-22. 10.1097/00001199-199812000-00004.PubMedGoogle Scholar
- Rush AJ, First MB, Blacker D: Handbook of Psychiatric Measures. 2008, Washington, DC: American Psychiatric Publishers, SecondGoogle Scholar
- Blanchet A, Batt M, Trognon A, Masse L: Language and behaviour patterns in a therapeutic interaction sequence. The Hidden Structure of Interaction. Edited by: Anolli L Duncan S, Magnusson MS Riva G. 2005, Amsterdam: IOS Press, 123-139. Amsterdam: IOS PressGoogle Scholar
- Magnusson MS: Understanding social interaction: discovering hidden structure with model and algorithms. The Hidden Structure of Interaction. Edited by: Anolli L Duncan S, Magnusson MS Riva G. 2005, Amsterdam: IOS Press, Amsterdam: IOS PressGoogle Scholar
- Haynal-Reymond V, Jonsson GK, Magnussion MS: Nonverbal communication in doctor-suicidal patient interview. The Hidden Structure of Interaction. Edited by: Anolli L Duncan S, Magnusson MS Riva G. 2005, Amsterdam: IOS Press, 141-148. Amsterdam: IOS PressGoogle Scholar
- Merten J, Schwab F: Facial expression patterns in common psychotherapeutic situations. The Hidden Structure of Interaction. Edited by: Anolli L Duncan S, Magnusson MS Riva G. 2005, Amsterdam: IOS Press, 149-158. Amsterdam: IOS PressGoogle Scholar
- Magnusson MS: Hidden real-time patterns in intra- and inter-individual behavior: description and detection. European Journal of Psychological Assessment. 1996, 12: 112-123. 10.1027/1015-5759.12.2.112.Google Scholar
- Magnusson MS: Discovering hidden time patterns in behavior: T-patterns and their detection. Behavior Research Methods, Instruments and Computers. 2000, 32 (1): 93-110. 10.3758/BF03200792.Google Scholar
- Rapp PE, Jiménez-Montaño MA, Langs RJ, Thomson L: Quantitative characterization of patient-therapist communication. Mathematical Biosciences. 1991, 105: 207-227. 10.1016/0025-5564(91)90082-T.PubMedGoogle Scholar
- Grünzig HJ, Holzscheck K, Kachele H: Programmsystem zur maschinellen Inhaltsanalyse von Psychotherapieprotokollen. Medizinische Psychologie. 1976, 2: 208-217.Google Scholar
- Pennebaker JW, Francis ME, Booth RJ: Linguistic Inquiry and Word Count (LIWC): LIWC2001. 2001, Mahwah, NJ: ErlbaumGoogle Scholar
- Pennebaker J, Mehl M, Niederhoffer K: Psychological aspects of natural language use: Our words, ourselves. Annual Review of Psychology. 2003, 54: 547-577. 10.1146/annurev.psych.54.101601.145041.PubMedGoogle Scholar
- Hart RP: Redeveloping DICTION: theoretical considerations. Theory, Method and Practice in Computer Analysis. Edited by: West MD. 2001, New York: Ablex, 43-60.Google Scholar
- Fast LA, Funder DC: Personality as manifest in word use: correlations with self-report, acquaintance report, and behavior. Journal of Personality and Social Psychology. 2008, 94: 334-346.PubMedGoogle Scholar
- Holt RR: Book review: In Search of Psychoanalytic Truth from Impression to Inquiry: A Tribute to the Work of Robert Wallerstein. Journal of the American Psychoanalytic Association. Edited by: Wilma Bucci, Norbert Freedman. 2008, London: International Psychoanalytic Association, 56 (3): 997-1009. 10.1177/0003065108324232.Google Scholar
- Dahl H: A quantitative study of a psychoanalysis. Psychoanalysis and Contemporary Science. Edited by: Holt RR, Peterfreund E. 1972, New York: Macmillan, 237-257.Google Scholar
- Dahl H: The measurement of meaning in psychoanalysis by computer analysis of verbal contexts. Journal of the American Psychoanalytic Association. 1974, 22: 37-57. 10.1177/000306517402200103.PubMedGoogle Scholar
- Dahl H, Teller V, Moss D, Trujillo M: Countertransference examples of the syntactic expression of warded off contents. Psychoanalytic Quarterly. 1978, 47: 339-363.PubMedGoogle Scholar
- Chomsky N: Reflections on Language. 1975, New York: PantheonGoogle Scholar
- Chomsky N: Conditions on rules of grammar. Linguistic Analysis. 1976, 2 (4): 303-351.Google Scholar
- Gottschalk LA, Gleser GC: The Measurement of Psychological States Through the Content of Verbal Behavior. 1969, University of California Press, Berkeley, CAGoogle Scholar
- Gottschalk LA, Fox RA, Bates DE: A study of prediction and outcome in a mental health crisis clinic. American Journal of Psychiatry. 1973, 130: 1107-1111.PubMedGoogle Scholar
- Gottschalk LA, Kunkel RL, Wohl T, Saenger E, Winget CN: Total and half body irradiation: effect on cognitive and emotional processes. Archives of General Psychiatry. 1969, 21: 574-580.PubMedGoogle Scholar
- Perley J, Winget CN, Placci C: Hope and discomfort as factors influencing treatment continuance. Comprehensive Psychiatry. 1971, 12: 557-563. 10.1016/0010-440X(71)90038-1.PubMedGoogle Scholar
- Lebovits AH, Holland JC: Use of the Gottschalk-Gleser verbal content analysis scales with medically ill patients. Psychosomatic Medicine. 1983, 45: 305-320.PubMedGoogle Scholar
- Gottschalk LA, Hoigaard-Martin J: Emotional impact of mastectomy. Psychiatry Research. 1986, 17: 153-167. 10.1016/0165-1781(86)90070-3.PubMedGoogle Scholar
- Viney LL, Westbrook MT: Psychological states in patients with diabetes mellitus. Content Analysis of Verbal Behavior. Edited by: L. A. Gottschalk LA, Lolas F, Viney LL. 1986, Berlin: Springer Verlag, 157-169.Google Scholar
- Langs R, Rapp PE, Pinto A, Cramer G, Badalamenti A: Three quantitative studies of gender and identity in psychotherapy consultations. American Journal of Psychotherapy. 1992, 46: 183-206.PubMedGoogle Scholar
- Jiménez-Montaño MA: On the syntactic structure of protein sequences and the concept of complexity. Bulletin of Mathematical Biology. 1984, 46: 641-659.Google Scholar
- Langs RJ: A Primer of Psychotherapy. 1988, New York: GardnerGoogle Scholar
- Stiles WB: Describing Talk: A Taxonomy of Verbal Response Modes. 1992, Newbury, CA: Sage PublicationsGoogle Scholar
- Stiles WB, Sultan FE: Verbal response mode used by clients in psychotherapy. Journal of Consulting and Clinical Psychology. 1979, 47 (3): 611-613.PubMedGoogle Scholar
- Stiles WB, McDaniel SH, McGaughey K: Verbal response mode correlates of experiencing. Journal of Consulting and Clinical Psychology. 1979, 47 (4): 795-797.PubMedGoogle Scholar
- Doba K, Pezard L, Lesne A, Vignau J, Christophe V, Nandrino JL: Dynamics of emotional expression in autobiographic speech of patients with anorexia nervosa. Psychological Reports. 2007, 101: 237-249.PubMedGoogle Scholar
- Doba K, Nandrino JL, Lesne A, Humez C, Pezard L: Organization of narrative components in autobiographical speech of anorexic adolescents: A statistical and nonlinear dynamical analysis. New Ideas in Psychology. 2008, 26: 295-308. 10.1016/j.newideapsych.2007.07.004.Google Scholar
- Leroy F, Pezard L, Nandrino JL, Beaune D: Dynamical quantification of schizophrenic speech. Psychiatry Research. 2005, 133 (2-3): 159-171. 10.1016/j.psychres.2004.07.009.PubMedGoogle Scholar
- Kintsch W, van Dijk TA: Toward a model of text comprehension and production. Psychological Review. 1978, 85 (5): 363-394.Google Scholar
- Van Dijk TA, Kintsch W: Strategies of Discourse Comprehension. 1983, New York: Academic PressGoogle Scholar
- Linehan M: Cognitive and Behavioral Treatment of Borderline Personality Disorder. 1993, The Guildford Press, NYGoogle Scholar
- Linehan MM: Skills Training Manual for Treating Borderline Personality Disorder. 1993, New York: Guilford PressGoogle Scholar
- Stiles WB, Shapiro DA, Firth-Cozens JA: Therapist differences in the use of verbal response mode forms and intents. Psychotherapy. 1989, 26: 314-322.Google Scholar
- Rapp PE, Schmah TI: Dynamical analysis in clinical practice. Chaos in Brain?. Edited by: Lehnertz K, Arnhold J Grassberger P, Elger CD. 2000, World Scientific, Singapore, 52-65.Google Scholar
- Rapp PE, Zimmerman ID, Vining EP, Cohen N, Albano AM, Jiménez-Montaño MA: The algorithmic complexity of neural spike trains increases during focal seizures. Journal of Neuroscience. 1994, 14: 4731-4739.PubMedGoogle Scholar
- McDaniel SH, Stiles WB, McGaughey KJ: Correlations of male college student's verbal response mode use in psychotherapy with measures of psychological disturbance and psychotherapy outcome. Journal of Consulting and Clinical Psychology. 1981, 49 (4): 571-582.PubMedGoogle Scholar
- Winefield HR, Basset DL, Chandler MA, Proske I: Process in psychotherapy as decreasing asymmetry between patient and therapist: evidence from verbal interaction. American Journal of Psychotherapy. 1987, 41 (1): 117-126.PubMedGoogle Scholar
- Lempel A, Ziv J: On the complexity of finite sequences. IEEE Transactions on Information Theory. 1976, IT-22: 75-81.Google Scholar
- Gallager RG: Information Theory and Reliable Communication. 1968, New York: John Wiley and SonsGoogle Scholar
- Cellucci CJ, Albano AM, Rapp PE: Statistical validation of mutual information calculations: comparisons of alternative numerical algorithms. Physical Review E. 2005, 71: 066208-1 to 066208-14Google Scholar
- Shannon CE: A mathematical theory of communication. Bell System Technical Journal. 1948, 27: 379-423.Google Scholar
- Shannon CE: Prediction and entropy of printed English. Bell System Technical Journal. 1951, 30: 50-64.Google Scholar
- Burton NG, Licklider JCR: Long-range constraints in the statistical structure of printed English. American Journal of Psychology. 1955, 68 (4): 650-653. 10.2307/1418794.PubMedGoogle Scholar
- Cover T, King R: A convergent gambling estimate of the entropy of English. IEEE Transactions on Information Theory. 1978, 24 (4): 413-421. 10.1109/TIT.1978.1055912.Google Scholar
- Kolmogorov AN: Three approaches to the quantitative definition of information. Problems of Information Processing. 1965, 1: 3-11. Translated from the Russian EditionGoogle Scholar
- Ebeling W: Prediction and entropy of nonlinear dynamical systems and symbolic sequences with LRO. Physica D. 1997, 109 (1-2): 42-52. 10.1016/S0167-2789(97)00157-7.Google Scholar
- Steuer R, Molgedey L, Ebeling W, Jiménez-Montaño M-A: Entropy and optimal partition for data analysis. European Physical Journal Series B. 2001, 19: 265-269.Google Scholar
- Schmitt AO, Herzel H, Ebeling W: A new method to calculate higher-order entropies from finite samples. Europhysics Letters. 23: 303-309.Google Scholar
- Grassberger P: Toward a quantitative theory of self-generated complexity. International Journal of Theoretical Physics. 1986, 25 (9): 907-938. 10.1007/BF00668821.Google Scholar
- Ebeling W, Muschik W, eds: Statistical Physics and Thermodynamics of Nonlinear Nonequilbrium Systems. 1992, Singapore: World ScientificGoogle Scholar
- Gramss T: Entropy of the symbolic sequence for critical circle maps. Physical Review E. 1994, 50 (4): 2616-2620. 10.1103/PhysRevE.50.2616.Google Scholar
- Ebeling W, Feistel R, Herzel H: Dynamics and complexities of biomolecules. Physica Scripta. 1987, 35: 761-768. 10.1088/0031-8949/35/5/033.Google Scholar
- Herzel H: Complexity of symbol sequences. Systems Analysis, Modeling, Simulation. 1988, 5 (5): 435-444.Google Scholar
- Herzel H, Schmitt AO, Ebeling W: Finite sample effects in sequence analysis. Chaos, Solitons and Fractals. 1994, 4 (1): 97-113. 10.1016/0960-0779(94)90020-5.Google Scholar
- Schmitt A: Structural analysis of DNA sequences. Ph.D. thesis. 1995, Humboldt-Universität, Berlin, Mathematisch-Naturwissenschaftliche Fakultät IGoogle Scholar
- Schürmann T, Grassberger P: Entropy estimation of symbol sequences. Chaos. 1996, 6: 414-427. 10.1063/1.166191.PubMedGoogle Scholar
- Dudok de Wit T: When do finite sample sizes significantly affect entropy estimates?. European Physical Journal B. 1999, 11: 513-516. 10.1007/s100510050963.Google Scholar
- Lesne A, Blanc JL, Pezard L: Entropy estimation of very short symbol sequences. Physical Review E. 2009, 79: 046208-Google Scholar
- Alvarez-Lacalle E, Dorow B, Eckmann JP, Moses E: Hierarchical structures induces long-range dynamical correlations in written texts. Proceedings of the National Academy of Sciences, USA. 2006, 103: 7956-7961. 10.1073/pnas.0510673103.Google Scholar
- Manning CD, Schütze H: Foundations of Statistical Natural language Processing. 1999, Cambridge, MA: MIT PressGoogle Scholar
- Beeferman D, Berger A, Lafferty JD: Statistical models for text segmentation. Machine Learning. 1999, 34: 177-210. 10.1023/A:1007506220214.Google Scholar
- Nowak MA, Komarova N, Niyogi P: Computational and evolutionary aspects of language. Nature. 2002, 417: 611-617. 10.1038/nature00771.PubMedGoogle Scholar
- Montemurro MA, Zanette DH: Universal entropy of word ordering across linguistic families. PLoS One. 2001, 6 (5): e19875-Google Scholar
- Xu J, Liu ZR, Liu R: The measure of sequence complexity for EEG studies. Chaos, Solitons and Fractals. 1994, 4: 2111-2119. 10.1016/0960-0779(94)90125-2.Google Scholar
- Redington DJ, Reidbord SP: Chaotic dynamics in autonomic nervous-system activity of a patient during a psychotherapy session. Biological Psychiatry. 1992, 31: 993-1007. 10.1016/0006-3223(92)90093-F.PubMedGoogle Scholar
- Bütz MR: Practical applications from chaos theory to the psychotherapeutic process. Psychological Reports. 1993, 73: 543-554.PubMedGoogle Scholar
- Schiepek G, Kowalik ZJ, Schütz A, Köhler M, Richter K, Strunk G, Mühlnickel W, Elbert T: Psychotherapy as a chaotic process. I. Coding the client-therapist interaction by means of sequential plan analysis and the search for chaos: a stationary approach. Psychotherapy Research. 1997, 7 (2): 173-194. 10.1080/10503309712331331953.Google Scholar
- Kowalik ZJ, Schiepek G, Kumpf K, Roberts LE, Elbert T: Psychotherapy as a chaotic process. II. The applications of nonlinear analysis methods on quasi-time series of the client-therapist interaction: a nonstationary approach. Psychotherapy Research. 1997, 7 (3): 197-218. 10.1080/10503309712331331973.Google Scholar
- Chamberlain L, Bütz MR, eds: Clinical Chaos: A Therapist's Guide to Nonlinear Dynamics and Therapeutic Change. 1998, Philadelphia: Taylor and FrancisGoogle Scholar
- Schiepek G: Complexity and nonlinear dynamics in psychotherapy. European Review. 2009, 17 (2): 331-356. 10.1017/S1062798709000763.Google Scholar
- Priel B, Schreiber G: On psychoanalysis and non-linear dynamics. The paradigm of bifurcation. British Journal of Medical Psychology. 1994, 67: 209-218. 10.1111/j.2044-8341.1994.tb01788.x.PubMedGoogle Scholar
- Tschacher W, Scheier C, Grawe K: Order and pattern formation in psychotherapy. Nonlinear Dynamics, Psychology and Life Sciences. 1998, 2: 195-215. 10.1023/A:1022324018097.Google Scholar
- Tschacher W, Baur N, Grawe K: Temporal interaction of process variables in psychotherapy. Psychotherapy Research. 2000, 10: 296-309. 10.1093/ptr/10.3.296.Google Scholar
- Nandrino JL, Leroy F, Pezard L: Dynamics as a heuristic framework for psychopathology. Chaos and Complexity Letters. 2005, 1 (2): 145-177.Google Scholar
- Waskow IE: Specification of the technique variable in the NIMH treatment of depression collaborative research program. Psychotherapy Research: Where are We and Where Should We Go?. Edited by: Williams JBW, Spitzer RL. 1984, New York: Guilford Press, 150-159. 1984Google Scholar
- Granacher RP: Traumatic Brain Injury. Methods for Clinical and Forensic Neuropsychological Assessment. 2008, Boca Raton, FL: CRC Press, SecondGoogle Scholar
- Penn C, Cleary J: Compensatory strategies in the language of closed head injured patients. Brain Injury. 1988, 2 (1): 3-19. 10.3109/02699058809150928.PubMedGoogle Scholar
- Sohlberg MM, Mateer C: Cognitive Rehabilitation. An Integrative Neuropsychological Approach. 2001, New York: Guilford PressGoogle Scholar
- Coelho CA: Discourse production deficits following traumatic brain injury: a critical review of the recent literature. Aphasiology. 1995, 9: 409-429. 10.1080/02687039508248707.Google Scholar
- Coelho C, Youse KM: Cognitive-communicaton rehabilitation following traumatic brain injury. Medical Speech-Language Pathology. A Practitioner's Guide. Edited by: A. F. Johnson B. H. Jacobson. 2007, New York: Thieme Medical Publishers, 71-93. SecondGoogle Scholar
- Blakemore D: Understanding Utterances: The Pragmatics of Natural Language. 1990, Oxford: BlackwellGoogle Scholar
- Martin I, McDonald S: Weak coherence, no theory of mind or executive dysfunction? Solving the problem of pragmatic language disorders. Brain and Language. 2003, 85: 451-466. 10.1016/S0093-934X(03)00070-1.PubMedGoogle Scholar
- Nicholas LE, Brookshire RH: Comprehension of spoken narrative discourse by adults with aphasia, right-hemisphere damage, or traumatic brain injury. American Journal of Speech-Language Pathology. 1995, 4: 69-81.Google Scholar
- Friedland D, Miller N: Conversation analysis of communication breakdown after closed head injury. Brain Injury. 1998, 12 (1): 1-14. 10.1080/026990598122818.PubMedGoogle Scholar
- McDonald S: Pragmatic language skills after closed head injury: Ability to meet the informational needs of the listener. Brain and Language. 1993, 44 (1): 28-46. 10.1006/brln.1993.1003.PubMedGoogle Scholar
- Baltaxe CAM: Pragmatic deficits in the language of autistic adolescents. Journal of Pediatric Psychology. 1977, 2 (4): 176-180. 10.1093/jpepsy/2.4.176.Google Scholar
- Loveland KA, Landry SH, Hughes SO, Hall SK, McEvoy RE: Speech acts and the pragmatic deficits of autism. Journal of Speech and Hearing Research. 1988, 31: 593-604.PubMedGoogle Scholar
- Camarata SM, Gibson T: Pragmatic language deficits in attention-deficit hyperactivity disorder. Mental Retardation and Developmental Disabilities Research Reviews. 1999, 5 (3): 207-214. 10.1002/(SICI)1098-2779(1999)5:3<207::AID-MRDD7>3.0.CO;2-O.Google Scholar
- Mitchell RLC, Crow TJ: Right hemisphere language functions and schizophrenia: the forgotten hemisphere. Brain. 2005, 128 (5): 963-978. 10.1093/brain/awh466.PubMedGoogle Scholar
- Champagne-Lavau M, Stip E, Joanette Y: Language functions in right-hemisphere damage and schizophrenia: apparently similar pragmatic deficits may hide profound differences. Brain. 2007, 130 (2): e67-10.1093/brain/awl311.PubMedGoogle Scholar
- Brownell H, Martino G: Deficits in inference and social cognition: the effects of right hemisphere damage on discourse. Right Hemisphere Language Comprehension: Perspectives from Cognitive Neuroscience. Edited by: Beeman M, Chiarello C. 1998, Mahwah, NJ: Lawrence Erlbaum Associates, 309-328.Google Scholar
- Santoro J, Spiers M: Social cognitive factors in brain injury-associated personality change. Brain Injury. 1994, 8 (3): 265-276. 10.3109/02699059409150978.PubMedGoogle Scholar
- Turkstra LS, Dixon TM, Baker KK: Theory of Mind and social beliefs in adolescents with traumatic brain injury. Neurorehabilitation. 2004, 19 (3): 245-256.PubMedGoogle Scholar
- Bibby H, McDonald S: Theory of mind after traumatic brain injury. Neuropsychologia. 2005, 43: 99-114. 10.1016/j.neuropsychologia.2004.04.027.PubMedGoogle Scholar
- Havet-Thomassin V, Allain P, Etcharry-Bouyx F, Le Gall D: What about theory of mind after severe brain injury?. Brain Injury. 2006, 20 (1): 83-91. 10.1080/02699050500340655.PubMedGoogle Scholar
- Henry JD, Phillips LH, Crawford JR, Ietswaart M, Summers F: Theory of mind following traumatic brain injury: the role of emotion recognition and executive dysfunction. Neuropsychologia. 2006, 44 (10): 1623-1628. 10.1016/j.neuropsychologia.2006.03.020.PubMedGoogle Scholar
- Martin-Rodriquez JF, Leon-Carrion J: Theory of mind deficits in patients with acquired brain injury: A quantitative review. Neuropsychologia. 2010, 48 (5): 1181-1191. 10.1016/j.neuropsychologia.2010.02.009.Google Scholar
- Frith U: Autism: Explaining the Enigma. 1989, Oxford: BlackwellGoogle Scholar
- Jolliffe T, Baron-Cohen S: A test of central coherence theory: can adults with high-functioning autism or Asperger syndrome integrate fragments of an object?. Cognitive Neuropsychiatry. 2001, 6 (3): 193-216. 10.1080/13546800042000124.PubMedGoogle Scholar
- Happé F, Frith U: The weak coherence account: Detailed focused cognitive style in autism and spectrum disorders. Journal of Autism and Developmental Disorders. 2006, 36: 5-25. 10.1007/s10803-005-0039-0.PubMedGoogle Scholar
- Goldberg E: The Executive Brain: Frontal Lobes and the Civilized Mind. 2001, Oxford: Oxford University PressGoogle Scholar
- Miller EK, Cohen JD: An integrative theory of prefrontal cortex function. Annual Reviews of Neuroscience. 2001, 24: 167-202. 10.1146/annurev.neuro.24.1.167.Google Scholar
- Douglas JM: Relation of executive functioning to pragmatic outcome following severe traumatic brain injury. Journal of Speech, Language and Hearing Research. 2010, 53: 365-382. 10.1044/1092-4388(2009/08-0205).Google Scholar
- McDonald S: Exploring the process of inference generation in sarcasm: A review of normal and clinical studies. Brain and Language. 1999, 68 (3): 486-506. 10.1006/brln.1999.2124.PubMedGoogle Scholar
- Booth R, Charlton R, Hughes C, Happé F: Disentangling weak coherence and executive dysfunction: planning drawing in autism and attention-deficit/hyperactivity disorder. Philosophical Transactions of the Royal Society. Series B. Biological Sciences. 2003, 358 (1430): 387-392. 10.1098/rstb.2002.1204.Google Scholar
- Burnette CP, Mundy PC, Meyer JA, Sutton SK, Vaughan AE, Charak D: Weak central coherence and its relations to theory of mind and anxiety in autism. Journal of Autism and Developmental Disorders. 2005, 35 (1): 63-73. 10.1007/s10803-004-1035-5.PubMedGoogle Scholar
- Pellicano E, Maybery M, Maley A: Multiple cognitive capabilities/deficits in children with an autism spectrum disorder: "weak" central coherence and its relation to theory of mind and executive control. Developmental Psychopathology. 2006, 18 (1): 77-98.Google Scholar
- Snow P, Douglas J, Ponsford J: Conversational assessment following traumatic brain injury: a comparison across two control groups. Brain Injury. 1997, 11 (6): 409-429. 10.1080/026990597123403.PubMedGoogle Scholar
- Pellicano E, Maybery M, Maley A: Multiple cognitive capabilities/deficits in children with an autism spectrum disorder: "weak" central coherence and its relation to theory of mind and executive control. Developmental Psychopathology. 2006, 18 (1): 77-98.Google Scholar
- Friedland D, Miller N: Conversation analysis of communication breakdown after closed head injury. Brain Injury. 1998, 12 (1): 1-14. 10.1080/026990598122818.PubMedGoogle Scholar
- Coelho CA, Liles BZ, Duffy RL, Clarkson YV: Conversational patterns of aphasic, closed-head-injured and normal speakers. Clinical Aphasiology. 1993, 21: 183-192.Google Scholar
- Coelho CA, Youse KM, Le K: Conversational discourse in closed-head-injury and non-brain-injured adults. Aphasiology. 2002, 16 (4-6): 659-672.Google Scholar
- Damico JS: Clinical discourse analysis: A functional approach to language assessment. Communication Skills and Classroom Success. Edited by: Simon CS. 1985, London: Taylor and Francis, 165-203.Google Scholar
- Damico JS: Clinical discourse analysis: A functional approach to language assessment. assessment and therapy methodologies for language and learning disabled students. Communication Skills and Classroom Success. 1991, Eau Claire, WI: Thinking Publications, 125-150.Google Scholar
- Chapman SB: Cognitive-communication abilities in children with closed head injury. American Journal of Speech-Language Pathology. 1997, 6 (2): 50-58.Google Scholar
- Chapman SB, Watkins R, Gustafson C, Moore S, Levin HS, Kufera JA: Narrative discourse in children with closed head injury, children with language impairment and typically developing children. American Journal of Speech-Language Pathology. 1997, 6 (2): 66-75.Google Scholar
- Body R, Parker M: Topic repetitiveness after traumatic brain injury: An emergent jointly managed behaviour. Clinical Linguistics and Phonetics. 2005, 19 (5): 379-392. 10.1080/02699200400027189.PubMedGoogle Scholar
- Morris J, Bleiberg J: Neuropsychological rehabilitation and traditional psychotherapy. International Journal of Clinical Neuropsychology. 1986, 8: 133-135.Google Scholar
- Judd D, Wilson SL: Psychotherapy with brain injury survivors: an investigation of the challenges encountered by clinicians and their modifications to therapeutic practice. Brain Injury. 2005, 19 (6): 437-449. 10.1080/02699050400010994.PubMedGoogle Scholar
- Chaitin GJ: Information theoretical computational complexity. IEEE Transactions on Information Theory. 1974, IT20: 10-15.Google Scholar
- Zvonkin AK, Levin LA: The complexity of finite-objects and the development of the concepts of information and randomness by means of the theory of algorithms. Russian Mathemathical Surveys. 1970, 25: 83-124. 10.1070/RM1970v025n06ABEH001269.Google Scholar
- Li M, Vitányi P: An Introduction to Kolmogorov Complexity and Its Applications. 1993, New York: Springer-VerlagGoogle Scholar
- Ebeling W, Jiménez-Montaño MA: On grammars, complexity and information measures of biological macromolecules. Mathematical Biosciences. 1980, 52: 53-71. 10.1016/0025-5564(80)90004-8.Google Scholar
- Watanabe TAA, Cellucci CJ, Kohegyi E, Bashore TR, Josiassen RC, Greenbaun NN, Rapp PE: The algorithmic complexity of multichannel EEGs is sensitive to changes in behavior. Psychophysiology. 2003, 40: 77-97. 10.1111/1469-8986.00009.PubMedGoogle Scholar
- Rapp PE: Quantitative characterization of animal behavior following blast exposure. Cognitive Neurodynamics. 2007, 1: 287-293. 10.1007/s11571-007-9027-8.PubMedPubMed CentralGoogle Scholar
- Radhakrishnan N, Wilson D, Loizou PC: An alternative partitioning technique to quantify the regularity of complex time series. International Journal of Bifurcation and Chaos. 10: 1773-1779.Google Scholar
- Bradley PS, Fayyad UM: Refining initial points for k-means clustering. Proceedings of the Fifteenth Conference on Machine Learning. Edited by: I Brasko S. Dzeroski. 1998, New York: Morgan KaufmanGoogle Scholar
- Hirata Y, Judd K, Kilminster D: Estimating a generating partition from observed time series: symbolic shadowing. Physical Review E. 2004, 70: 016215-Google Scholar
- Rapp PE, Albano AM, Zimmerman ID, Jiménez-Montaño MA: Phase-randomized surrogates can produce spurious identifications of non-random structure. Physics Letters. 1994, 192A: 27-33.Google Scholar
- Rapp PE, Cellucci CJ, Korslund KE, Watanabe TAA, Jiménez-Montaño MA: An effective normalization of complexity measurements for epoch length and sampling frequency. Physical Review. 2001, 64E: 016209-1-016209-9.Google Scholar
- Rapp PE, Cellucci CJ, Watanabe TAA, Albano AM: Quantitative characterization of the complexity of multichannel human EEGs. International Journal of Bifurcation and Chaos. 2005, 15: 1737-1744. 10.1142/S0218127405012764.Google Scholar
- Barnard GA: Discussion on the spectral analysis of point processes by M. S. Bartlett. Journal of the Royal Statistical Society. 1963, 25B: 294-Google Scholar
- Hope ACA: A simplified Monte Carlo significance test procedure. Journal of the Royal Statistical Society. 1968, 30B: 582-598.Google Scholar
- Rössler OE: An equation for continuous chaos. Physics Letters. 1976, 57A: 397-398.Google Scholar
- Lambert JD: Computational Methods in Ordinary Differential Equations. 1976, New York, Wiley, NYGoogle Scholar
- Lorenz EN: Deterministic non-periodic flow. Journal of Atmospheric Science. 1963, 20: 130-141. 10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2.Google Scholar
- Sparrow CT: The Lorenz Equations. 1982, Berlin: Springer-VerlagGoogle Scholar
- Hénon M: A two dimensional mapping with a strange attactor. Communications in Mathematical Physics. 1976, 50: 69-77. 10.1007/BF01608556.Google Scholar
- Hitzl DH, Zele F: An exploration of the Hénon quadratic map. Physica D. 1985, 14: 305-326. 10.1016/0167-2789(85)90092-2.Google Scholar
- Press WH, Flannery BP, Teukolsky SA, Vetterling WT: Numerical Recipes. The Art of Scientific Computing. 1986, Cambridge: Cambridge University PressGoogle Scholar
- L'Ecuyer P: Efficient portable combined random number generators. Communicaitons of the ACM. 1988, 31 (6): 742-750. 10.1145/62959.62969.Google Scholar
- Bays C, Carter SD: Improving a poor random number generator. ACM Transactions on Mathematical Software. 1976, 2 (1): 59-64. 10.1145/355666.355670.Google Scholar
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1471-244X/11/119/prepub

### Pre-publication history

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.